-- Logs begin at Tue 2022-07-12 16:42:28 UTC, end at Tue 2022-07-12 17:51:26 UTC. -- Jul 12 17:16:57.739117 dv-cinder-849325-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 17:16:57.749279 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 17:16:57.750050 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 17:16:57 2022] *** Jul 12 17:16:57.750050 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 17:16:57.750050 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 17:16:57.750050 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: nodename: dv-cinder-849325-2-iscsi Jul 12 17:16:57.750050 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: machine: x86_64 Jul 12 17:16:57.750050 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: clock source: unix Jul 12 17:16:57.750050 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: pcre jit disabled Jul 12 17:16:57.750050 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: detected number of CPU cores: 4 Jul 12 17:16:57.750050 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: current working directory: / Jul 12 17:16:57.750050 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: detected binary path: /usr/bin/uwsgi-core Jul 12 17:16:57.750050 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: your processes number limit is 47680 Jul 12 17:16:57.750723 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: your memory page size is 4096 bytes Jul 12 17:16:57.750723 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: detected max file descriptor number: 2048 Jul 12 17:16:57.750723 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: lock engine: pthread robust mutexes Jul 12 17:16:57.750723 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: thunder lock: enabled Jul 12 17:16:57.750723 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 17:16:57.750723 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 17:16:57.794136 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: Python main interpreter initialized at 0x55bde4bcd9c0 Jul 12 17:16:57.794136 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: python threads support enabled Jul 12 17:16:57.794136 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: your server socket listen backlog is limited to 100 connections Jul 12 17:16:57.794136 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: your mercy for graceful operations on workers is 90 seconds Jul 12 17:16:57.794469 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 17:16:57.794563 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: *** Operational MODE: preforking *** Jul 12 17:16:57.794819 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: *** uWSGI is running in multiple interpreter mode *** Jul 12 17:16:57.794819 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: spawned uWSGI master process (pid: 103176) Jul 12 17:16:57.795004 dv-cinder-849325-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 17:16:57.795545 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: spawned uWSGI worker 1 (pid: 103177, cores: 1) Jul 12 17:16:57.795876 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: spawned uWSGI worker 2 (pid: 103178, cores: 1) Jul 12 17:16:57.796133 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 17:16:58.450993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 17:16:58.458134 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 17:16:59.564369 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 17:16:59.564369 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: from cryptography.utils import int_from_bytes Jul 12 17:16:59.565002 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 17:16:59.565002 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: from cryptography.utils import int_from_bytes Jul 12 17:16:59.567154 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 17:16:59.567154 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: from cryptography.utils import int_from_bytes Jul 12 17:16:59.567613 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 17:16:59.567613 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: from cryptography.utils import int_from_bytes Jul 12 17:17:02.028747 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 17:17:02.029393 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 17:17:02.029393 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 17:17:02.029797 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 17:17:02.029914 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 17:17:02.030288 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 17:17:02.030377 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 17:17:02.030466 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.030637 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 17:17:02.030728 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.031001 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 17:17:02.031105 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.031259 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 17:17:02.031357 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.031646 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.031734 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.031954 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.032042 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.032277 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.032372 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.032594 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.032696 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.032919 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.033012 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.033181 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.033275 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.033494 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.033597 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.033845 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849325-2-iscsi {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.033946 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.034168 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.034257 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.034428 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.034527 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.034743 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.034832 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.035628 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849325-2-iscsi {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.035724 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.035955 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.036050 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.036266 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.036368 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.036575 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.036662 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.036892 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.037067 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.037197 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.037512 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.037647 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.037864 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.037972 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.038326 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.038445 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.038530 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.038704 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.038821 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.039011 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.039106 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.039323 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.039421 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.039661 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.039763 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.039974 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.040067 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.040286 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.040388 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.040606 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.040717 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849325-2-iscsi {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.040916 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.041025 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.041240 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.041349 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.041548 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.041651 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.041962 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849325-2-iscsi {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.042059 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.042280 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.042372 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.042611 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.042714 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.042910 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.043006 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.043229 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.043315 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.043536 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.043623 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.043863 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.043949 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.044181 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.044267 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.044500 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.044594 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.044818 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.044904 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.045122 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.045217 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.045432 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.045524 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.045763 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.045864 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.046085 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.046185 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.046388 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.046474 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.046691 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.046776 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.046943 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.047044 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.047250 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.047344 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.047572 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.047659 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.047889 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.047977 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.048139 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.048224 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.048450 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.048554 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.048695 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.048789 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.049013 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.049106 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.049335 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.049431 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.049622 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.049734 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.049899 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.049986 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.050220 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.050319 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.050561 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.050649 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.050874 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.050971 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.051176 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.051262 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.051481 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.051566 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.051785 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.051871 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.052090 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.052176 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.052399 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.052485 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.052706 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.052845 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.053010 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.053096 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.053325 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.053417 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.053739 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.053830 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.053993 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.054080 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.054298 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.054384 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.054634 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.054730 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.054952 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.055049 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.055258 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.055351 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.055575 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.055673 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.055894 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.055980 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.056200 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.056295 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.056503 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.056602 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.056806 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.056893 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.057126 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.057213 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.057433 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.057527 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.057769 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.057857 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.058019 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.058115 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.058320 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.058419 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.058626 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.058725 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.058939 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.059026 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.059243 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.059329 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.059544 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.059629 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.059849 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.059942 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.060148 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.060247 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.060451 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.060544 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.060754 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.060840 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.061058 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.061151 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.061358 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.061442 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.061660 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.061794 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.061984 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.062071 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.062290 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.062380 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.062593 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.062753 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.062897 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.062985 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.063197 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.063282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.063504 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.063606 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.063809 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.063919 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.064129 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.064220 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.064416 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.064510 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.064719 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.064812 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.065037 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.065129 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.065338 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.065431 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.065643 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.065749 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.065971 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.066065 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.066299 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.066397 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.066603 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.066689 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.066911 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.066995 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.067211 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.067306 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.067514 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.067600 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.067823 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.067907 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.068122 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.068216 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.068429 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.068515 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.068737 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.068833 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.069039 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.069393 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.069609 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.069714 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.069936 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.070036 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.070241 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.070338 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.070546 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.070632 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.070852 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.070938 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.071154 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.071247 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.071459 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.071557 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.071758 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.071859 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.072072 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.072174 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.072378 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.072471 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.072685 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.072774 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.072988 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.073082 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.073292 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.073377 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.073611 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.073811 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.073942 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.074027 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.074252 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.074339 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.074560 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.074655 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.074880 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:17:02.074967 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.075216 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.075302 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.075553 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.075649 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.075870 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.075955 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.076184 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.076271 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.076499 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.076598 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.076826 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.076916 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.077140 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.077227 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.077452 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.077546 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.077785 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.077890 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.078107 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.078194 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.078420 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.078506 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.078744 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.078876 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.079048 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.079155 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.079363 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.079451 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.079681 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.079774 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.079991 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.080077 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.080309 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.080404 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.080625 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.080711 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.080945 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.081037 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.081255 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.081347 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.081573 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.081660 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.082465 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.082558 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.082786 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.082882 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.083113 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.083199 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.083436 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.083531 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.083750 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.083843 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.084063 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.084156 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.084375 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.084534 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.084698 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.084793 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.085018 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.085103 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.085331 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.085427 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.085644 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.085760 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.085982 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.086069 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.086296 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.086395 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.086607 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.086694 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.086919 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.087016 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.087229 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.087321 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.087543 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.087641 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.087854 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.087948 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.088166 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.088254 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.088475 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.088561 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.088793 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.088887 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.089107 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.089201 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.089420 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.089506 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.089749 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.089850 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.090058 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.090146 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.090363 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.090456 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.090667 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.090762 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.090975 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.091070 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.091280 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.091366 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.091588 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.091682 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.091894 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.091982 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.092202 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.092288 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.092524 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.092626 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.092822 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.092926 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.093128 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.093250 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.093439 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.093538 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.093770 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.093874 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.094079 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.094166 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.094392 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.094492 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.094700 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.094786 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.095003 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.095089 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.095308 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.095394 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.095622 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.095708 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.095924 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.096010 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.096229 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.096315 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.096537 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.096631 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.096842 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.096936 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.097144 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.097237 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.097516 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.098207 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.098367 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.098465 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.098675 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.098763 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.098995 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.099127 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.099307 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.099403 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.099621 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.099709 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.099933 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.100026 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.100243 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.100338 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.100569 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.100657 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.100880 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.100966 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.101193 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.101291 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.101521 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.101624 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.101870 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.101958 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.102178 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.102265 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.102486 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.102579 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.102798 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.102892 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.103102 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.103190 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.103406 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.103493 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.103714 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.103799 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.104015 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.104103 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.104318 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.104405 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.104620 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.104719 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.104922 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.105010 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.105225 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.105310 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.105529 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.105624 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.105859 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.105959 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.106161 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.106247 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.106463 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.106557 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.106767 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.106854 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.107080 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.107166 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.107386 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.107482 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.107690 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.107777 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.107995 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.108088 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.108338 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.108434 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.108646 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.108740 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.108955 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.109042 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.109271 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.109359 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.109582 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.109668 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.109920 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.110007 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.110234 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.110329 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.110547 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.110634 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.110859 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.110952 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.111173 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.111269 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.111480 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.111566 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.111788 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.111875 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.112107 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.112194 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.112415 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.112500 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.112732 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.112817 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.113062 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.113156 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.113386 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.113517 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.113718 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.113885 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.114038 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.114125 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.114346 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.114434 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.114661 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.114756 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.114974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.115068 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.115289 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.115376 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.115599 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.115703 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.115908 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.116002 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.116217 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.116304 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.116525 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.116624 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.116834 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.116920 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.117140 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.117232 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.117449 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.117537 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.117778 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.117878 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.118099 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.118185 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.118405 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.118492 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.118722 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.118807 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.119023 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.119110 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.119337 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.119425 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.119644 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.119730 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.119964 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.120050 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.120270 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.120357 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.120579 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.120666 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.120905 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.120994 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.121215 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.121303 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.121525 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.121618 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.121856 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.121959 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.122163 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.122255 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.122466 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.122553 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.122775 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.122873 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.123087 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.123174 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.123393 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.123480 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.123700 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.123797 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.124006 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.124092 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.124322 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.124409 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.124630 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.124723 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.124930 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.125016 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.125233 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.125318 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.125541 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.125627 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.125873 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.125961 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.126181 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.126269 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.126486 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.126574 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.126799 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.126886 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.127102 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.127233 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.127408 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.127496 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.127726 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.127818 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.128033 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.128119 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.128338 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.128426 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.128641 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.128733 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.128976 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.129070 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.129283 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.129404 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.129589 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.129722 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.129915 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.130015 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.130221 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.130307 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.130538 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.130623 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.130847 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.130941 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.131148 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.131240 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.131455 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.131540 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.131766 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.131865 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.132072 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.132158 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.132384 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.132471 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.132689 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.132775 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.132993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.133085 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.133299 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.133385 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.133610 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.133714 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.133943 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.134030 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.134258 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.134380 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.134566 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.134653 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.134871 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.134957 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.135178 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.135264 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.135482 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.135569 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.135790 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.135875 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.136098 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.136197 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.136406 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.136661 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.136748 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.136994 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.137079 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.137308 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.137396 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.137626 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.137889 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.137989 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.138225 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.138321 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.138543 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.138629 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.138864 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.138950 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.139185 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.139280 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.139506 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.139602 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.139819 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.139911 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.140127 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.140213 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.140434 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.140530 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.140746 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.140842 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.141051 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.141138 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.141355 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.141454 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.141659 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.141809 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.141992 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.142079 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.142294 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.142398 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.142599 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.142686 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.142904 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.142992 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.143208 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.143295 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.143510 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.143595 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.143814 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.143907 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.144123 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.144211 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.144947 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.145037 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.145264 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.145352 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.145571 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.145658 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.145901 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.146006 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.146208 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.146323 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.146515 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.146601 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.146828 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.146916 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.147133 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.147228 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.147436 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.147523 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.147740 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.147834 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.148082 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.148177 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.148388 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.148483 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.148697 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.148783 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.149020 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.149115 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.149329 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.149415 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.149634 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.149737 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.149965 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.150066 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.150277 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.150364 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.150581 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.150667 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.150881 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.150969 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.151184 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.151270 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.151493 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.151579 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.151799 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.151892 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.152103 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.152191 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.152404 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.152490 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.152713 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.152799 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.153015 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.153101 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.153322 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.153408 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.153627 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.153743 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.153958 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.154047 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.154260 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.154354 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.154570 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.154658 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.154878 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.155010 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.155183 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.155280 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.155491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.155578 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.155793 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.155879 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.156109 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.156204 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.156414 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.156501 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.156718 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.156811 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.157019 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.157113 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.157326 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.157413 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.157628 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.157767 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.157957 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.158045 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.158260 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.158348 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.158571 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.158659 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.158873 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.158960 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.159175 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.159261 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.159481 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.159573 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.159785 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.159873 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.160641 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.160735 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.160948 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.161043 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.161258 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.161354 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.161562 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.161649 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.161890 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.161987 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.162200 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.162286 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.162507 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.162594 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.162814 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.162909 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.163117 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.163202 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.163428 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.163514 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.163727 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.163821 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.164029 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.164116 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.164329 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.164420 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.164632 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.164728 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.164933 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.165058 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.165235 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.165322 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.165540 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.165628 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.165879 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.165967 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.166184 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.166270 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.166491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.166580 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.166804 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.166889 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.167108 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.167196 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.167411 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.167500 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.167716 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.167803 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.168058 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.168144 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.168361 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.168448 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.168673 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.168759 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.168984 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.169084 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.169299 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.169386 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.169603 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.169717 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.169941 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.170043 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.170249 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.170343 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.170562 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.170655 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.170866 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.170961 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.171173 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.171268 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.171482 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.171575 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.171796 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.171896 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.172113 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.172218 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.172406 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.172498 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.172725 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.172824 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.173036 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.173176 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.173344 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.173430 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.173655 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.173804 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.173989 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.174111 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.174299 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.174397 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.174606 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.174693 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.174913 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.175040 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.175222 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.175334 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.175556 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.175672 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.175867 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.175953 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.176181 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.176269 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.176492 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.176580 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.176799 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.176886 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.177107 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.177202 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.177414 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.177501 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.177739 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.177827 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.178045 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.178144 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.178355 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.178451 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.178657 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.178744 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.178960 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.179055 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.179263 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.179349 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.179573 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.179660 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.179875 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.180016 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.180184 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.180296 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.180487 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.180607 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.180795 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.180920 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.181103 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.181227 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.181529 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.181617 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.181863 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.181961 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.182171 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.182257 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.182478 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.182578 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.182780 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.182867 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.183088 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.183181 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.183404 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.183491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.183718 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.183806 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.184022 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.184108 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.184381 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.184474 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.184686 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.184773 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.184995 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.185093 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.185318 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.185417 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.185618 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.185759 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.185946 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.186044 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.186250 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.186350 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.186570 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.186657 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.186872 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.187011 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.187174 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.187331 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.187478 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.187591 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.187797 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.187927 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.188100 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.188188 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.188419 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.188587 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.188831 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.188919 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.189142 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.189229 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.189450 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.189538 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.189834 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.189925 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.190161 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.190250 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.190464 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.190559 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.190777 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.190864 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.191086 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.191212 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.191432 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.191521 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.191734 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.191820 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.192046 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.192134 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.192354 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.192450 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.192655 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.192747 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.192977 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.193073 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.193282 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.193375 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.193594 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.193694 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.193928 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.194028 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.194521 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.194618 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.194849 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.194943 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.195162 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.195258 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.195482 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.195619 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.195832 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.195918 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.196140 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.196237 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.196447 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.196534 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.196761 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.196848 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.197068 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.197156 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.197373 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.197472 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.197734 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.197837 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.198023 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.198112 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.198331 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.198417 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.198636 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.198723 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.198958 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.199047 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.199265 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.199353 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.199565 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.199652 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.199881 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.199968 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.200178 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.200265 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.200483 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.200579 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.200791 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.200879 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.201108 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.201195 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.201409 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.201504 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.201741 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.201830 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.202067 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.202156 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.202379 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.202476 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.202685 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.202772 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.202989 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.203075 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.203296 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.203391 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.203607 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.203693 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.203912 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.203999 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.204216 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.204311 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.204520 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.204607 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.204864 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.204957 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.205166 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.205261 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.205486 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.205584 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.205830 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.205919 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.206148 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.206237 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.206457 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.206550 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.207273 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.207369 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.207595 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.207686 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.207900 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.207994 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.208208 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.208304 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.208511 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.208599 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.208815 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.208902 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.209115 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.209213 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.209421 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.209508 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.209744 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.209834 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.210052 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.210149 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.210357 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.210445 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.210665 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.210753 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.210969 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.211056 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.211267 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.211352 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.211570 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.211657 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.211873 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.211968 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.212177 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.212265 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.212478 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.212565 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.212787 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.212875 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.213089 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.213177 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.213395 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.213481 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.213734 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.213825 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.214061 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.214148 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.214367 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.214532 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.214685 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.214773 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.215004 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.215090 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.215320 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.215416 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.215637 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.215723 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.215948 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.216034 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.216261 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.216355 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.216577 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.216670 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.216890 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.216977 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.217204 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.217298 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.217510 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.217596 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.217845 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.217934 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.218160 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.218261 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.218472 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.218558 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.218781 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.218984 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.219079 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.219312 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.219399 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.219626 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.219714 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.219938 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.220204 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.220293 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.220540 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.220627 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.220849 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.220935 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.221158 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.221254 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.221466 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.221552 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.221795 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.221960 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.222108 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.222195 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.222440 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.223019 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.223275 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.223373 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.223590 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.223679 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.223903 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.223991 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.224233 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.224329 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.224555 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.224643 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.224876 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.224970 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.225191 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.225280 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.225522 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.225621 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.225861 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.225961 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.226167 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.226262 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.226481 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.226567 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.226796 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.226890 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.227111 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.227199 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.227423 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.227510 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.227734 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.227831 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.228045 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.228141 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.228357 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.228444 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.228666 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.228761 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.228972 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.229065 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.229282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.229376 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.229596 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.229711 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.229921 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.230009 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.230231 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.230319 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.230544 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.230640 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.230856 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.230944 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.231175 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.231262 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.231490 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.231578 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.231815 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.232006 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.232129 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.232322 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.232443 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.232653 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.232747 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.232977 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.233259 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.233355 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.233575 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.233666 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.233932 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.234020 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.234256 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.234355 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.234564 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.234652 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.234870 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.234959 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.235181 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.235276 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.235491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.235580 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.235797 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.235884 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.236101 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.236200 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.236412 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.236499 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.236713 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.236800 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.237017 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.237111 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.237330 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.237423 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.237637 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.237898 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.237999 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.238267 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.238394 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.238583 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.238670 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.238908 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.239112 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.239233 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.239454 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.239541 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.239770 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.239866 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.240098 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.240194 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.240425 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.240512 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.240740 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.240835 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.241046 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.241133 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.241354 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.241440 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.241658 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.241780 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.241986 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.242074 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.242298 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.242387 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.242607 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.242695 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.242909 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.243002 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.243212 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.243299 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.243512 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.243600 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.243819 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.243905 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.244124 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.244211 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.244433 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.244520 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.244736 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.244822 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.245045 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.245140 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.245351 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.245446 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.245653 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.245757 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.245978 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.246126 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.246285 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.246373 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.246587 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.246673 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.246888 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.246983 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.247191 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.247284 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.247493 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.247587 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.247800 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.247895 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.248102 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.248188 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.248407 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.248544 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.248711 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.248807 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.249022 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.249109 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.249327 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.249415 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.249635 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.249784 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.249972 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.250059 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.250281 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.250374 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.250602 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.250741 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.250903 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.250989 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.251209 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.251295 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.251517 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.251606 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.251838 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.251933 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.252147 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.252373 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.252474 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.252712 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.252801 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.253031 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.253117 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.253363 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.253607 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.253732 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.253997 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.254084 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.254318 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.254422 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.254636 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.254730 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.254961 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.255049 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.255274 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.255368 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.255583 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.255670 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.255893 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.255980 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.256204 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.256300 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.256512 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.256600 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.256818 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.256920 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.257127 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.257222 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.257435 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.257521 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.257763 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.257914 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.258071 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.258161 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.258377 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.258465 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.258683 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.258778 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.258991 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.259079 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.259299 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.259386 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.259608 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.259704 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.259919 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.260006 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.260228 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.260315 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.260539 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.260634 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.260853 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.260954 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.261161 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.261249 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.261470 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.261566 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.261805 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.261907 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.262117 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.262205 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.262426 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.262522 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.262736 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.262824 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.263046 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.263135 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.263343 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.263431 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.263654 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.263741 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.263982 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.264070 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.264315 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.264422 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.264606 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.264699 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.264962 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.265070 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.265281 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.265369 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.265600 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.265737 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.265934 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.266103 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.266254 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.266420 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.266562 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.266746 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.266889 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.267070 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.267224 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.267386 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.267548 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.267708 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.267868 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.268020 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.268172 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.268351 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.268477 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.268692 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.268788 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.269021 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.269108 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.269879 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.270052 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.270195 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.270292 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.270485 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.270581 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.270783 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.270917 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.271090 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.271187 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.271391 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.271479 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.271692 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.271779 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.271993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.272086 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.272306 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.272398 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.272597 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.272685 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.272898 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.272985 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.273196 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.273289 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.273496 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.273584 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.273818 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.273908 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.274120 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.274206 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.274420 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.274508 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.274720 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.274807 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.275018 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.275104 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.275318 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.275412 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.275615 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.275709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.276137 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.276247 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.276392 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.276513 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.276825 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.276956 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.277133 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.277439 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.277516 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.277766 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.278073 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.278167 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.278408 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.278686 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.278815 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.279043 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.279257 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.279363 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.279676 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.279859 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.279997 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.280306 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.280457 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.280702 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.280949 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.281034 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.281252 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.281562 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.281657 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.281918 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.282230 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.282324 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.282542 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.282696 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.282853 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.283165 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.283313 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.283477 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.283787 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.283918 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.284116 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.284443 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.284529 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.284851 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.285624 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.285758 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.285981 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.286248 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.286336 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.286607 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.286837 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.286925 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.287243 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.287460 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.287609 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.287736 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.287830 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.288143 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.288231 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.288450 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.288574 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.288761 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.288919 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.289075 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.289248 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.289391 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.289577 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.289738 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.289927 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.290065 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.290249 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.290374 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.290588 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.290683 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.290907 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.291014 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.291221 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.291347 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.291541 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.291660 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.291854 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.292002 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.292169 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.292332 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.292488 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.292663 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.292808 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.292956 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.293138 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.293264 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.293469 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.293565 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 17:17:02.293806 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.294144 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.294473 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.294825 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.295141 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.295486 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.295821 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.296138 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.296453 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.296765 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:17:02.297011 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 17:17:02.355744 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO dbcounter [None req-3915110f-8c98-4bf2-a2ea-d3b5082bb10e None None] Registered counter for database nova_api Jul 12 17:17:02.358935 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO dbcounter [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] Registered counter for database nova_api Jul 12 17:17:02.469363 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG oslo_db.sqlalchemy.engines [None req-3915110f-8c98-4bf2-a2ea-d3b5082bb10e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:17:02.470943 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_db.sqlalchemy.engines [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:17:02.475959 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writer thread running {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:17:02.477196 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG dbcounter [-] [103178] Writer thread running {{(pid=103178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:17:02.530686 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.context [None req-3915110f-8c98-4bf2-a2ea-d3b5082bb10e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),38cb94f1-249d-4d6f-82ce-acee8cef23f0(cell1) {{(pid=103177) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 17:17:02.531889 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.context [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),38cb94f1-249d-4d6f-82ce-acee8cef23f0(cell1) {{(pid=103178) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 17:17:02.534536 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-3915110f-8c98-4bf2-a2ea-d3b5082bb10e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:17:02.535832 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_concurrency.lockutils [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:17:02.536140 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-3915110f-8c98-4bf2-a2ea-d3b5082bb10e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:17:02.536929 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-3915110f-8c98-4bf2-a2ea-d3b5082bb10e None None] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:17:02.537397 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_concurrency.lockutils [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:17:02.538216 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_concurrency.lockutils [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:17:02.539070 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG oslo_concurrency.lockutils [None req-3915110f-8c98-4bf2-a2ea-d3b5082bb10e None None] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:17:02.540295 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_concurrency.lockutils [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:17:02.541006 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO dbcounter [None req-3915110f-8c98-4bf2-a2ea-d3b5082bb10e None None] Registered counter for database nova_cell0 Jul 12 17:17:02.542282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO dbcounter [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] Registered counter for database nova_cell0 Jul 12 17:17:02.544820 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO dbcounter [None req-3915110f-8c98-4bf2-a2ea-d3b5082bb10e None None] Registered counter for database nova_cell1 Jul 12 17:17:02.546058 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO dbcounter [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] Registered counter for database nova_cell1 Jul 12 17:17:02.552814 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG oslo_db.sqlalchemy.engines [None req-3915110f-8c98-4bf2-a2ea-d3b5082bb10e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:17:02.555978 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_db.sqlalchemy.engines [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:17:02.557400 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writer thread running {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:17:02.558071 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG oslo_db.sqlalchemy.engines [None req-3915110f-8c98-4bf2-a2ea-d3b5082bb10e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:17:02.559122 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_db.sqlalchemy.engines [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:17:02.562564 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG dbcounter [-] [103178] Writer thread running {{(pid=103178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:17:02.697265 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writer thread running {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:17:02.699734 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG dbcounter [-] [103178] Writer thread running {{(pid=103178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:17:02.705985 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO dbcounter [None req-3915110f-8c98-4bf2-a2ea-d3b5082bb10e None None] Registered counter for database nova_cell0 Jul 12 17:17:02.710416 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO dbcounter [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] Registered counter for database nova_cell0 Jul 12 17:17:02.715294 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG oslo_db.sqlalchemy.engines [None req-3915110f-8c98-4bf2-a2ea-d3b5082bb10e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:17:02.716926 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_db.sqlalchemy.engines [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:17:02.719597 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writer thread running {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:17:02.721190 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG dbcounter [-] [103178] Writer thread running {{(pid=103178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:17:03.051124 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: WARNING keystonemiddleware.auth_token [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 17:17:03.053923 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: WARNING keystonemiddleware.auth_token [None req-3915110f-8c98-4bf2-a2ea-d3b5082bb10e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 17:17:03.058433 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: WARNING keystonemiddleware.auth_token [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 17:17:03.061113 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: WARNING keystonemiddleware.auth_token [None req-3915110f-8c98-4bf2-a2ea-d3b5082bb10e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 17:17:03.395385 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: WARNING keystonemiddleware.auth_token [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 17:17:03.401220 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: WARNING keystonemiddleware.auth_token [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 17:17:03.402043 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: WARNING keystonemiddleware.auth_token [None req-3915110f-8c98-4bf2-a2ea-d3b5082bb10e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 17:17:03.406429 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bde4bcd9c0 pid: 103178 (default app) Jul 12 17:17:03.407979 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: WARNING keystonemiddleware.auth_token [None req-3915110f-8c98-4bf2-a2ea-d3b5082bb10e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 17:17:03.408471 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:17:03.409635 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] 10.222.0.62 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001702 Jul 12 17:17:03.410101 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 788 bytes} [Tue Jul 12 17:17:03 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:17:03.413249 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bde4bcd9c0 pid: 103177 (default app) Jul 12 17:18:18.436084 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:18:18.437723 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001976 Jul 12 17:18:18.438301 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 2/2] 10.222.0.62 () {54 vars in 930 bytes} [Tue Jul 12 17:18:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:18:18.451002 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_api:SELECT=3 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:18.452235 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_cell0:SELECT=3 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:18.453353 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_cell1:SELECT=3 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:18.454725 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:19.304063 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-ac42e5c4-89c7-4838-a9e0-040470f0bb5c admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:18:19.334533 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-ac42e5c4-89c7-4838-a9e0-040470f0bb5c admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.888958 Jul 12 17:18:19.335099 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 1/3] 10.222.0.62 () {60 vars in 1291 bytes} [Tue Jul 12 17:18:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:18:21.587446 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:18:21.588448 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-e8d5e2ac-2622-4948-a510-ae2c0e1c8690 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001384 Jul 12 17:18:21.588858 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 3/4] 10.222.0.62 () {54 vars in 930 bytes} [Tue Jul 12 17:18:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:18:22.037011 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-cf6e16ae-d2d9-4506-8aab-e1b0a3e90f9b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "disk": 1, "ram": 256, "vcpus": 1, "id": "c1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:18:22.055594 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:18:22.055594 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: warnings.warn(msg) Jul 12 17:18:22.082301 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-cf6e16ae-d2d9-4506-8aab-e1b0a3e90f9b admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.487454 Jul 12 17:18:22.083070 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 2/5] 10.222.0.62 () {64 vars in 1282 bytes} [Tue Jul 12 17:18:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:18:22.098049 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG dbcounter [-] [103178] Writing DB stats nova_api:SELECT=3 {{(pid=103178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:22.099418 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG dbcounter [-] [103178] Writing DB stats nova_cell0:SELECT=3 {{(pid=103178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:22.100275 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG dbcounter [-] [103178] Writing DB stats nova_cell1:SELECT=3 {{(pid=103178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:22.101190 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG dbcounter [-] [103178] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:22.309469 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-0a92c738-9dcc-42ae-9945-e2e0962a42a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:18:22.312129 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:18:22.312129 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: warnings.warn(msg) Jul 12 17:18:22.376164 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-0a92c738-9dcc-42ae-9945-e2e0962a42a8 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285115 Jul 12 17:18:22.381238 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 4/6] 10.222.0.62 () {64 vars in 1335 bytes} [Tue Jul 12 17:18:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:18:24.646766 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-cf6e16ae-d2d9-4506-8aab-e1b0a3e90f9b admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:18:24.648500 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-cf6e16ae-d2d9-4506-8aab-e1b0a3e90f9b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002171 Jul 12 17:18:24.649137 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 3/7] 10.222.0.62 () {54 vars in 930 bytes} [Tue Jul 12 17:18:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:18:25.329270 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-3bc7877c-75d7-4f1a-927a-70cdcebcaf2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M", "os-flavor-access:is_public": true, "disk": 5}} {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:18:25.349415 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:18:25.349415 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: warnings.warn(msg) Jul 12 17:18:25.371461 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-3bc7877c-75d7-4f1a-927a-70cdcebcaf2b admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.715898 Jul 12 17:18:25.372892 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 5/8] 10.222.0.62 () {64 vars in 1282 bytes} [Tue Jul 12 17:18:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:18:25.384323 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-6f07d811-6984-4f3c-a764-be989523ce1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:18:25.385833 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:18:25.385833 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: warnings.warn(msg) Jul 12 17:18:25.418175 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-6f07d811-6984-4f3c-a764-be989523ce1f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037433 Jul 12 17:18:25.419048 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 4/9] 10.222.0.62 () {64 vars in 1335 bytes} [Tue Jul 12 17:18:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:18:27.635901 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-3bc7877c-75d7-4f1a-927a-70cdcebcaf2b admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:18:27.637022 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-3bc7877c-75d7-4f1a-927a-70cdcebcaf2b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 12 17:18:27.642325 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 6/10] 10.222.0.62 () {54 vars in 930 bytes} [Tue Jul 12 17:18:27 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:18:28.069757 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-b7f86cf0-3c41-4371-bd63-7e9de3a9e951 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "disk": 10, "swap": 0}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:18:28.087616 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-b7f86cf0-3c41-4371-bd63-7e9de3a9e951 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.443944 Jul 12 17:18:28.088157 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 5/11] 10.222.0.62 () {64 vars in 1282 bytes} [Tue Jul 12 17:18:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 17:18:28.100450 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-450157ad-8ac9-4e20-8533-56746f05d648 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:18:28.123790 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-450157ad-8ac9-4e20-8533-56746f05d648 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027112 Jul 12 17:18:28.124338 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 7/12] 10.222.0.62 () {64 vars in 1335 bytes} [Tue Jul 12 17:18:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:18:30.326646 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-b7f86cf0-3c41-4371-bd63-7e9de3a9e951 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:18:30.327655 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-b7f86cf0-3c41-4371-bd63-7e9de3a9e951 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 12 17:18:30.328353 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 6/13] 10.222.0.62 () {54 vars in 930 bytes} [Tue Jul 12 17:18:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:18:30.745220 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-cd7f0da3-cd8a-43b3-816c-7115eaa44fff admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "d3", "name": "ds2G", "disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0}} {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:18:30.777557 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-cd7f0da3-cd8a-43b3-816c-7115eaa44fff admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.442952 Jul 12 17:18:30.778718 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 8/14] 10.222.0.62 () {64 vars in 1282 bytes} [Tue Jul 12 17:18:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:18:30.791224 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-c0223c29-4bde-4ea7-8503-142f491ed836 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:18:30.821063 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-c0223c29-4bde-4ea7-8503-142f491ed836 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032561 Jul 12 17:18:30.823975 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 7/15] 10.222.0.62 () {64 vars in 1335 bytes} [Tue Jul 12 17:18:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:18:33.053452 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-cd7f0da3-cd8a-43b3-816c-7115eaa44fff admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:18:33.054472 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-cd7f0da3-cd8a-43b3-816c-7115eaa44fff admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 12 17:18:33.055112 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 9/16] 10.222.0.62 () {54 vars in 930 bytes} [Tue Jul 12 17:18:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:18:33.487457 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-640c10e3-71d3-4c06-af44-4c4a3abf6dc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4", "disk": 20, "vcpus": 4}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:18:33.510667 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-640c10e3-71d3-4c06-af44-4c4a3abf6dc5 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.450016 Jul 12 17:18:33.511555 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 8/17] 10.222.0.62 () {64 vars in 1282 bytes} [Tue Jul 12 17:18:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:18:33.524720 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-c4e8daa0-73fa-4998-8940-ccff87c87100 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:18:33.550546 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-c4e8daa0-73fa-4998-8940-ccff87c87100 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030072 Jul 12 17:18:33.551529 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 10/18] 10.222.0.62 () {64 vars in 1335 bytes} [Tue Jul 12 17:18:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:18:35.767164 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-640c10e3-71d3-4c06-af44-4c4a3abf6dc5 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:18:35.768723 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-640c10e3-71d3-4c06-af44-4c4a3abf6dc5 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002697 Jul 12 17:18:35.769437 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 9/19] 10.222.0.62 () {54 vars in 930 bytes} [Tue Jul 12 17:18:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:18:36.226046 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-99eb62da-c82a-40d7-8a2a-0d8edbc44218 admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:18:36.256924 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-99eb62da-c82a-40d7-8a2a-0d8edbc44218 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.479703 Jul 12 17:18:36.257625 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 11/20] 10.222.0.62 () {60 vars in 1291 bytes} [Tue Jul 12 17:18:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:18:38.864943 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-640c10e3-71d3-4c06-af44-4c4a3abf6dc5 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:18:38.866429 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-640c10e3-71d3-4c06-af44-4c4a3abf6dc5 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002008 Jul 12 17:18:38.866937 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 10/21] 10.222.0.62 () {54 vars in 930 bytes} [Tue Jul 12 17:18:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:18:39.276426 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-256265e9-703f-4465-9b66-5ffdb8e8b135 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "1", "rxtx_factor": 1.0, "disk": 1}} {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:18:39.296159 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-256265e9-703f-4465-9b66-5ffdb8e8b135 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.423367 Jul 12 17:18:39.297102 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 12/22] 10.222.0.62 () {64 vars in 1282 bytes} [Tue Jul 12 17:18:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:18:39.308900 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-a1248d67-6341-4057-878d-6eb97533cd5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:18:39.332888 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-a1248d67-6341-4057-878d-6eb97533cd5c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027694 Jul 12 17:18:39.333471 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 11/23] 10.222.0.62 () {64 vars in 1332 bytes} [Tue Jul 12 17:18:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:18:41.550656 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-256265e9-703f-4465-9b66-5ffdb8e8b135 admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:18:41.551667 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-256265e9-703f-4465-9b66-5ffdb8e8b135 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 12 17:18:41.552069 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 13/24] 10.222.0.62 () {54 vars in 930 bytes} [Tue Jul 12 17:18:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:18:41.948616 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-af9a14a6-efb6-4102-ba94-729dfb0549cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "swap": 0, "vcpus": 1, "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "2"}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:18:41.966353 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-af9a14a6-efb6-4102-ba94-729dfb0549cc admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.408671 Jul 12 17:18:41.966851 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 12/25] 10.222.0.62 () {64 vars in 1282 bytes} [Tue Jul 12 17:18:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 17:18:41.978629 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-87ff706d-4eb0-4f29-9db9-d4e9926264f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:18:42.001044 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-87ff706d-4eb0-4f29-9db9-d4e9926264f1 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025523 Jul 12 17:18:42.001609 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 14/26] 10.222.0.62 () {64 vars in 1332 bytes} [Tue Jul 12 17:18:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:18:44.197179 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-af9a14a6-efb6-4102-ba94-729dfb0549cc admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:18:44.198581 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-af9a14a6-efb6-4102-ba94-729dfb0549cc admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002033 Jul 12 17:18:44.198993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 13/27] 10.222.0.62 () {54 vars in 930 bytes} [Tue Jul 12 17:18:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:18:44.571819 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-fcfe4101-2e5d-41f7-a6c4-2f475b91f091 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "disk": 40, "id": "3"}} {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:18:44.592789 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-fcfe4101-2e5d-41f7-a6c4-2f475b91f091 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.387539 Jul 12 17:18:44.593483 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 15/28] 10.222.0.62 () {64 vars in 1282 bytes} [Tue Jul 12 17:18:44 2022] POST /compute/v2.1/flavors => generated 406 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:18:44.606400 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-51d73a27-93d1-4d3e-bb1d-cdff0efeabb4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:18:44.641275 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-51d73a27-93d1-4d3e-bb1d-cdff0efeabb4 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038807 Jul 12 17:18:44.645866 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 14/29] 10.222.0.62 () {64 vars in 1332 bytes} [Tue Jul 12 17:18:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:18:46.871975 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-fcfe4101-2e5d-41f7-a6c4-2f475b91f091 admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:18:46.872988 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-fcfe4101-2e5d-41f7-a6c4-2f475b91f091 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 12 17:18:46.873384 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 16/30] 10.222.0.62 () {54 vars in 930 bytes} [Tue Jul 12 17:18:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:18:47.302411 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-3a5c6fa2-98a8-471a-ad39-aad7dcd70018 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "4", "disk": 80, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "ram": 8192, "swap": 0}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:18:47.321928 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-3a5c6fa2-98a8-471a-ad39-aad7dcd70018 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.442853 Jul 12 17:18:47.322758 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 15/31] 10.222.0.62 () {64 vars in 1282 bytes} [Tue Jul 12 17:18:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 17:18:47.334933 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-6659608b-a8f2-4fc5-bed4-2f9c7ee24cf2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:18:47.360275 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-6659608b-a8f2-4fc5-bed4-2f9c7ee24cf2 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028967 Jul 12 17:18:47.360970 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 17/32] 10.222.0.62 () {64 vars in 1332 bytes} [Tue Jul 12 17:18:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:18:49.647518 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-3a5c6fa2-98a8-471a-ad39-aad7dcd70018 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:18:49.648472 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-3a5c6fa2-98a8-471a-ad39-aad7dcd70018 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jul 12 17:18:49.648870 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 16/33] 10.222.0.62 () {54 vars in 930 bytes} [Tue Jul 12 17:18:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:18:50.080538 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-60c8b919-0bec-4360-acf7-84ac371a2e9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "disk": 160, "rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "swap": 0}} {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:18:50.103939 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-60c8b919-0bec-4360-acf7-84ac371a2e9e admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.449054 Jul 12 17:18:50.104959 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 18/34] 10.222.0.62 () {64 vars in 1282 bytes} [Tue Jul 12 17:18:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 17:18:50.117500 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-31201541-f6b1-49da-8ec2-a9a10d6a56b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:18:50.121357 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:50.144273 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-31201541-f6b1-49da-8ec2-a9a10d6a56b6 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030743 Jul 12 17:18:50.145179 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 17/35] 10.222.0.62 () {64 vars in 1332 bytes} [Tue Jul 12 17:18:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:19:09.547683 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-60c8b919-0bec-4360-acf7-84ac371a2e9e admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:09.548689 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-60c8b919-0bec-4360-acf7-84ac371a2e9e admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001941 Jul 12 17:19:09.549085 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 19/36] 10.222.0.62 () {54 vars in 930 bytes} [Tue Jul 12 17:19:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:19:09.559417 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:09.934386 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-f363610d-5d37-4964-9bbe-09c0640a26a8 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:09.950935 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-f363610d-5d37-4964-9bbe-09c0640a26a8 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.395939 Jul 12 17:19:09.951466 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 18/37] 10.222.0.62 () {60 vars in 1291 bytes} [Tue Jul 12 17:19:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:19:11.012798 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-60c8b919-0bec-4360-acf7-84ac371a2e9e admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:11.013833 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-60c8b919-0bec-4360-acf7-84ac371a2e9e admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Jul 12 17:19:11.014232 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 20/38] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Jul 12 17:19:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:19:11.539331 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-659606b0-e9ed-40f7-978d-fd77e06addc9 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:11.544871 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.wsgi [None req-659606b0-e9ed-40f7-978d-fd77e06addc9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-659606b0-e9ed-40f7-978d-fd77e06addc9 admin admin] Request method failure captured: Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Accept: application/json Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Accept-Encoding: gzip, deflate Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Connection: keep-alive Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Content-Length: 0 Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Host: 10.222.0.62 Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Openstack-Api-Version: compute 2.90 Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Openstack-System-Scope: None Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: User-Agent: python-novaclient Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Auth-Token: gAAAAABiza0O9nLbCK2VqySj-B88wup-gojUYQphsbGnI9f0l-lBa_D2-q4WQpPkXjlfQbYld3ycuhxw9mBzCnz-8xgoj8OD7lv0TquDWtGbTzQ8yrWrsYHFtnnnPOxsvnGpWwzh6knyjcnu6VPR9QoTmVS7p_GyK99PSeayW08LgDO2ShpiWOE Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Domain-Id: None Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Domain-Name: None Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Identity-Status: Confirmed Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Is-Admin-Project: True Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Project-Domain-Id: default Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Project-Domain-Name: Default Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Project-Id: 0b1c4bb3b2b9474ba67275ac784a1403 Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Project-Name: admin Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Role: admin,reader,member Jul 12 17:19:11.548709 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Roles: admin,reader,member Jul 12 17:19:11.550451 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0b1c4bb3b2b9474ba67275ac784a1403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0b1c4bb3b2b9474ba67275ac784a1403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0b1c4bb3b2b9474ba67275ac784a1403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0b1c4bb3b2b9474ba67275ac784a1403", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:19:11.550451 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Tenant: admin Jul 12 17:19:11.550451 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Tenant-Id: 0b1c4bb3b2b9474ba67275ac784a1403 Jul 12 17:19:11.550451 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Tenant-Name: admin Jul 12 17:19:11.550451 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-User: admin Jul 12 17:19:11.550451 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-User-Domain-Id: default Jul 12 17:19:11.550451 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-User-Domain-Name: Default Jul 12 17:19:11.550451 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-User-Id: 95036fe6caa14165a48458f99b1674e5 Jul 12 17:19:11.550451 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-User-Name: admin Jul 12 17:19:11.550451 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: method: > Jul 12 17:19:11.550451 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: exception: Flavor 42 could not be found. Jul 12 17:19:11.550451 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: action_args: {'id': '42'} Jul 12 17:19:11.550451 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:19:11.550451 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:19:11.551530 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 17:19:11.551530 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 17:19:11.551530 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 17:19:11.551530 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 17:19:11.551530 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 17:19:11.551530 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 17:19:11.551530 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 17:19:11.551530 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 17:19:11.551530 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 17:19:11.551530 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:19:11.551530 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 17:19:11.551530 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 17:19:11.551530 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 17:19:11.551530 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 12 17:19:11.551530 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:19:11.551530 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 12 17:19:11.551530 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:19:11.551530 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:19:11.551530 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:19:11.552993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:19:11.552993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:19:11.552993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:19:11.552993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:19:11.552993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 17:19:11.552993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:19:11.552993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 17:19:11.552993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 12 17:19:11.552993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:19:11.552993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 12 17:19:11.552993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:19:11.552993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:19:11.552993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:19:11.552993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:19:11.552993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:19:11.552993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 17:19:11.552993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 12 17:19:11.552993 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-659606b0-e9ed-40f7-978d-fd77e06addc9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:19:11.554442 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-659606b0-e9ed-40f7-978d-fd77e06addc9 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.386087 Jul 12 17:19:11.554442 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 19/39] 10.222.0.62 () {60 vars in 1190 bytes} [Tue Jul 12 17:19:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:11.559782 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-ac8c07be-0c95-4b2f-bcd0-84ce9e5edb01 admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:11.562765 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG dbcounter [-] [103178] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:11.582132 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-ac8c07be-0c95-4b2f-bcd0-84ce9e5edb01 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025829 Jul 12 17:19:11.582668 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 21/40] 10.222.0.62 () {60 vars in 1210 bytes} [Tue Jul 12 17:19:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:19:11.592265 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-8c1161e5-0804-4822-9408-9cc8e08447b5 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:11.614718 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-8c1161e5-0804-4822-9408-9cc8e08447b5 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025983 Jul 12 17:19:11.615254 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 20/41] 10.222.0.62 () {60 vars in 1210 bytes} [Tue Jul 12 17:19:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:19:11.624378 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-cbc19bea-e28e-4319-907a-227e4811a9d9 admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:11.630700 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.wsgi [None req-cbc19bea-e28e-4319-907a-227e4811a9d9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-cbc19bea-e28e-4319-907a-227e4811a9d9 admin admin] Request method failure captured: Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Accept: application/json Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Accept-Encoding: gzip, deflate Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Connection: keep-alive Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Content-Length: 0 Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Host: 10.222.0.62 Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Openstack-Api-Version: compute 2.90 Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Openstack-System-Scope: None Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: User-Agent: python-novaclient Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Auth-Token: gAAAAABiza0O9nLbCK2VqySj-B88wup-gojUYQphsbGnI9f0l-lBa_D2-q4WQpPkXjlfQbYld3ycuhxw9mBzCnz-8xgoj8OD7lv0TquDWtGbTzQ8yrWrsYHFtnnnPOxsvnGpWwzh6knyjcnu6VPR9QoTmVS7p_GyK99PSeayW08LgDO2ShpiWOE Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Domain-Id: None Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Domain-Name: None Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Identity-Status: Confirmed Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Is-Admin-Project: True Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Project-Domain-Id: default Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Project-Domain-Name: Default Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Project-Id: 0b1c4bb3b2b9474ba67275ac784a1403 Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Project-Name: admin Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Role: admin,reader,member Jul 12 17:19:11.633974 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Roles: admin,reader,member Jul 12 17:19:11.635574 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0b1c4bb3b2b9474ba67275ac784a1403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0b1c4bb3b2b9474ba67275ac784a1403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0b1c4bb3b2b9474ba67275ac784a1403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0b1c4bb3b2b9474ba67275ac784a1403", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:19:11.635574 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Tenant: admin Jul 12 17:19:11.635574 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Tenant-Id: 0b1c4bb3b2b9474ba67275ac784a1403 Jul 12 17:19:11.635574 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Tenant-Name: admin Jul 12 17:19:11.635574 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-User: admin Jul 12 17:19:11.635574 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-User-Domain-Id: default Jul 12 17:19:11.635574 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-User-Domain-Name: Default Jul 12 17:19:11.635574 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-User-Id: 95036fe6caa14165a48458f99b1674e5 Jul 12 17:19:11.635574 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-User-Name: admin Jul 12 17:19:11.635574 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: method: > Jul 12 17:19:11.635574 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: exception: Flavor 42 could not be found. Jul 12 17:19:11.635574 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: action_args: {'id': '42'} Jul 12 17:19:11.635574 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:19:11.635574 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:19:11.636539 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 17:19:11.636539 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 17:19:11.636539 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 17:19:11.636539 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 17:19:11.636539 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 17:19:11.636539 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 17:19:11.636539 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 17:19:11.636539 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 17:19:11.636539 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 17:19:11.636539 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:19:11.636539 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 17:19:11.636539 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 17:19:11.636539 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 17:19:11.636539 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Jul 12 17:19:11.636539 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:19:11.636539 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Jul 12 17:19:11.636539 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:19:11.636539 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:19:11.636539 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:19:11.637877 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:19:11.637877 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:19:11.637877 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:19:11.637877 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:19:11.637877 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 17:19:11.637877 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:19:11.637877 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 17:19:11.637877 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Jul 12 17:19:11.637877 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:19:11.637877 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Jul 12 17:19:11.637877 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:19:11.637877 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:19:11.637877 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:19:11.637877 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:19:11.637877 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:19:11.637877 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 17:19:11.637877 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Jul 12 17:19:11.637877 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-cbc19bea-e28e-4319-907a-227e4811a9d9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:19:11.639183 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-cbc19bea-e28e-4319-907a-227e4811a9d9 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014457 Jul 12 17:19:11.639183 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 22/42] 10.222.0.62 () {60 vars in 1190 bytes} [Tue Jul 12 17:19:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 12 17:19:12.589495 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-8c1161e5-0804-4822-9408-9cc8e08447b5 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:12.590546 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-8c1161e5-0804-4822-9408-9cc8e08447b5 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 12 17:19:12.590944 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 21/43] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Jul 12 17:19:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:19:13.107871 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-dcef44ce-6032-479c-a700-43ca50ef42c6 admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:13.113783 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.wsgi [None req-dcef44ce-6032-479c-a700-43ca50ef42c6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-dcef44ce-6032-479c-a700-43ca50ef42c6 admin admin] Request method failure captured: Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Accept: application/json Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Accept-Encoding: gzip, deflate Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Connection: keep-alive Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Content-Length: 0 Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Host: 10.222.0.62 Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Openstack-Api-Version: compute 2.90 Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Openstack-System-Scope: None Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: User-Agent: python-novaclient Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Auth-Token: gAAAAABiza0Qr7_uIuNSFeheP1uJ3clIWLS_wGl7tW92OQi3M0wJDNPK2JvG0ruSaO684KChtgdckJ3NG4MLpo-tfsX_USGjuuNQPsdJPMhf5STvIiVsj90I4gnzCEoOt9ihxw19ouehmCEdKVLGj-Hwr09xNxWsuWvJL8AIsvw3CaKOjXBNev0 Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Domain-Id: None Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Domain-Name: None Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Identity-Status: Confirmed Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Is-Admin-Project: True Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Project-Domain-Id: default Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Project-Domain-Name: Default Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Project-Id: 0b1c4bb3b2b9474ba67275ac784a1403 Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Project-Name: admin Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Role: admin,reader,member Jul 12 17:19:13.115282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Roles: admin,reader,member Jul 12 17:19:13.116803 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0b1c4bb3b2b9474ba67275ac784a1403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0b1c4bb3b2b9474ba67275ac784a1403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0b1c4bb3b2b9474ba67275ac784a1403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0b1c4bb3b2b9474ba67275ac784a1403", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:19:13.116803 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Tenant: admin Jul 12 17:19:13.116803 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Tenant-Id: 0b1c4bb3b2b9474ba67275ac784a1403 Jul 12 17:19:13.116803 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Tenant-Name: admin Jul 12 17:19:13.116803 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-User: admin Jul 12 17:19:13.116803 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-User-Domain-Id: default Jul 12 17:19:13.116803 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-User-Domain-Name: Default Jul 12 17:19:13.116803 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-User-Id: 95036fe6caa14165a48458f99b1674e5 Jul 12 17:19:13.116803 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-User-Name: admin Jul 12 17:19:13.116803 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: method: > Jul 12 17:19:13.116803 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: exception: Flavor 84 could not be found. Jul 12 17:19:13.116803 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: action_args: {'id': '84'} Jul 12 17:19:13.116803 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:19:13.116803 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:19:13.117899 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 17:19:13.117899 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 17:19:13.117899 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 17:19:13.117899 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 17:19:13.117899 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 17:19:13.117899 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 17:19:13.117899 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 17:19:13.117899 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 17:19:13.117899 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 17:19:13.117899 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:19:13.117899 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 17:19:13.117899 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 17:19:13.117899 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 17:19:13.117899 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Jul 12 17:19:13.117899 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:19:13.117899 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Jul 12 17:19:13.117899 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:19:13.117899 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:19:13.117899 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:19:13.119179 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:19:13.119179 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:19:13.119179 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:19:13.119179 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:19:13.119179 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 17:19:13.119179 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:19:13.119179 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 17:19:13.119179 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Jul 12 17:19:13.119179 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:19:13.119179 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Jul 12 17:19:13.119179 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:19:13.119179 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:19:13.119179 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:19:13.119179 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:19:13.119179 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:19:13.119179 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 17:19:13.119179 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Jul 12 17:19:13.119179 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-dcef44ce-6032-479c-a700-43ca50ef42c6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:19:13.120450 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-dcef44ce-6032-479c-a700-43ca50ef42c6 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.388268 Jul 12 17:19:13.120450 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 23/44] 10.222.0.62 () {60 vars in 1190 bytes} [Tue Jul 12 17:19:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:13.126321 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-dbbedcb7-66c9-471a-8217-b7bf052f86d1 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:13.139812 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-dbbedcb7-66c9-471a-8217-b7bf052f86d1 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017112 Jul 12 17:19:13.140386 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 22/45] 10.222.0.62 () {60 vars in 1210 bytes} [Tue Jul 12 17:19:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:19:13.149814 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-5d4290d4-b327-4806-8afe-eee7368f510d admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:13.163759 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-5d4290d4-b327-4806-8afe-eee7368f510d admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017499 Jul 12 17:19:13.164279 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1210 bytes} [Tue Jul 12 17:19:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:19:13.173767 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-5b2496af-937e-4eb8-8767-4f92d517810a admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:13.178955 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.wsgi [None req-5b2496af-937e-4eb8-8767-4f92d517810a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-5b2496af-937e-4eb8-8767-4f92d517810a admin admin] Request method failure captured: Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Accept: application/json Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Accept-Encoding: gzip, deflate Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Connection: keep-alive Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Content-Length: 0 Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Host: 10.222.0.62 Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Openstack-Api-Version: compute 2.90 Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Openstack-System-Scope: None Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: User-Agent: python-novaclient Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Auth-Token: gAAAAABiza0Qr7_uIuNSFeheP1uJ3clIWLS_wGl7tW92OQi3M0wJDNPK2JvG0ruSaO684KChtgdckJ3NG4MLpo-tfsX_USGjuuNQPsdJPMhf5STvIiVsj90I4gnzCEoOt9ihxw19ouehmCEdKVLGj-Hwr09xNxWsuWvJL8AIsvw3CaKOjXBNev0 Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Domain-Id: None Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Domain-Name: None Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Identity-Status: Confirmed Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Is-Admin-Project: True Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Project-Domain-Id: default Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Project-Domain-Name: Default Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Project-Id: 0b1c4bb3b2b9474ba67275ac784a1403 Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Project-Name: admin Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Role: admin,reader,member Jul 12 17:19:13.180438 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Roles: admin,reader,member Jul 12 17:19:13.182013 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0b1c4bb3b2b9474ba67275ac784a1403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0b1c4bb3b2b9474ba67275ac784a1403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0b1c4bb3b2b9474ba67275ac784a1403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0b1c4bb3b2b9474ba67275ac784a1403", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:19:13.182013 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Tenant: admin Jul 12 17:19:13.182013 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Tenant-Id: 0b1c4bb3b2b9474ba67275ac784a1403 Jul 12 17:19:13.182013 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Tenant-Name: admin Jul 12 17:19:13.182013 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-User: admin Jul 12 17:19:13.182013 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-User-Domain-Id: default Jul 12 17:19:13.182013 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-User-Domain-Name: Default Jul 12 17:19:13.182013 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-User-Id: 95036fe6caa14165a48458f99b1674e5 Jul 12 17:19:13.182013 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-User-Name: admin Jul 12 17:19:13.182013 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: method: > Jul 12 17:19:13.182013 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: exception: Flavor 84 could not be found. Jul 12 17:19:13.182013 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: action_args: {'id': '84'} Jul 12 17:19:13.182013 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:19:13.182013 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:19:13.182924 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 17:19:13.182924 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 17:19:13.182924 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 17:19:13.182924 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 17:19:13.182924 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 17:19:13.182924 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 17:19:13.182924 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 17:19:13.182924 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 17:19:13.182924 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 17:19:13.182924 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:19:13.182924 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 17:19:13.182924 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 17:19:13.182924 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 17:19:13.182924 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 12 17:19:13.182924 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:19:13.182924 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 12 17:19:13.182924 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:19:13.182924 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:19:13.182924 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:19:13.184273 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:19:13.184273 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:19:13.184273 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:19:13.184273 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:19:13.184273 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 17:19:13.184273 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:19:13.184273 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 17:19:13.184273 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 12 17:19:13.184273 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:19:13.184273 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 12 17:19:13.184273 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:19:13.184273 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:19:13.184273 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:19:13.184273 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:19:13.184273 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:19:13.184273 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 17:19:13.184273 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 12 17:19:13.184273 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-5b2496af-937e-4eb8-8767-4f92d517810a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:19:13.185506 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-5b2496af-937e-4eb8-8767-4f92d517810a admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012198 Jul 12 17:19:13.185506 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 23/47] 10.222.0.62 () {60 vars in 1190 bytes} [Tue Jul 12 17:19:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:14.139736 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-5d4290d4-b327-4806-8afe-eee7368f510d admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:14.140772 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-5d4290d4-b327-4806-8afe-eee7368f510d admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 12 17:19:14.141159 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 25/48] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Jul 12 17:19:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:19:14.655386 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-bed10288-e62a-4395-ad5c-03939e335a3b admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:14.661575 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.wsgi [None req-bed10288-e62a-4395-ad5c-03939e335a3b admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-bed10288-e62a-4395-ad5c-03939e335a3b admin admin] Request method failure captured: Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Accept: application/json Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Accept-Encoding: gzip, deflate Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Connection: keep-alive Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Content-Length: 0 Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Host: 10.222.0.62 Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Openstack-Api-Version: compute 2.90 Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Openstack-System-Scope: None Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: User-Agent: python-novaclient Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Auth-Token: gAAAAABiza0SqCNgaUmOUIIz1ILc2o2JWZ-aJfy6BOFdaAO2NJBSRy_LuB3vuZszLMdqg2LLfT84GxkrFn3UeRBv0P0LppeN4FCUNaIccZrU4_eCokUROfNAc_P-9bh4GENIzJjHOL-08ZSsrq2V-fA11tnIdl_bn1UF0hnINOiNtlwxxmoO3ng Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Domain-Id: None Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Domain-Name: None Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Identity-Status: Confirmed Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Is-Admin-Project: True Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Project-Domain-Id: default Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Project-Domain-Name: Default Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Project-Id: 0b1c4bb3b2b9474ba67275ac784a1403 Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Project-Name: admin Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Role: admin,reader,member Jul 12 17:19:14.663102 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Roles: admin,reader,member Jul 12 17:19:14.664619 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0b1c4bb3b2b9474ba67275ac784a1403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0b1c4bb3b2b9474ba67275ac784a1403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0b1c4bb3b2b9474ba67275ac784a1403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0b1c4bb3b2b9474ba67275ac784a1403", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:19:14.664619 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Tenant: admin Jul 12 17:19:14.664619 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Tenant-Id: 0b1c4bb3b2b9474ba67275ac784a1403 Jul 12 17:19:14.664619 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-Tenant-Name: admin Jul 12 17:19:14.664619 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-User: admin Jul 12 17:19:14.664619 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-User-Domain-Id: default Jul 12 17:19:14.664619 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-User-Domain-Name: Default Jul 12 17:19:14.664619 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-User-Id: 95036fe6caa14165a48458f99b1674e5 Jul 12 17:19:14.664619 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: X-User-Name: admin Jul 12 17:19:14.664619 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: method: > Jul 12 17:19:14.664619 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: exception: Flavor 451 could not be found. Jul 12 17:19:14.664619 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: action_args: {'id': '451'} Jul 12 17:19:14.664619 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:19:14.664619 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:19:14.665680 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 17:19:14.665680 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 17:19:14.665680 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 17:19:14.665680 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 17:19:14.665680 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 17:19:14.665680 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 17:19:14.665680 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 17:19:14.665680 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 17:19:14.665680 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 17:19:14.665680 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:19:14.665680 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 17:19:14.665680 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 17:19:14.665680 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 17:19:14.665680 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 12 17:19:14.665680 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:19:14.665680 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 12 17:19:14.665680 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:19:14.665680 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:19:14.665680 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:19:14.667173 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:19:14.667173 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:19:14.667173 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:19:14.667173 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:19:14.667173 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 17:19:14.667173 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:19:14.667173 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 17:19:14.667173 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 12 17:19:14.667173 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:19:14.667173 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 12 17:19:14.667173 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:19:14.667173 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:19:14.667173 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:19:14.667173 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:19:14.667173 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:19:14.667173 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 17:19:14.667173 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: ERROR nova.api.openstack.wsgi Jul 12 17:19:14.667173 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-bed10288-e62a-4395-ad5c-03939e335a3b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:19:14.668417 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-bed10288-e62a-4395-ad5c-03939e335a3b admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.386782 Jul 12 17:19:14.668417 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 24/49] 10.222.0.62 () {60 vars in 1193 bytes} [Tue Jul 12 17:19:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:14.674697 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-9c965e5f-f594-427f-b34d-7a48ce5cbf95 admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:14.687884 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-9c965e5f-f594-427f-b34d-7a48ce5cbf95 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017379 Jul 12 17:19:14.688397 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 26/50] 10.222.0.62 () {60 vars in 1210 bytes} [Tue Jul 12 17:19:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:19:14.697672 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-3610649c-10bf-4b4d-aae8-1d1c8ceb848c admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:14.712237 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-3610649c-10bf-4b4d-aae8-1d1c8ceb848c admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017980 Jul 12 17:19:14.712761 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 25/51] 10.222.0.62 () {60 vars in 1210 bytes} [Tue Jul 12 17:19:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:19:14.722437 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-a12e3f37-a256-4d24-87ba-56b7ecf7b566 admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:14.727767 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.wsgi [None req-a12e3f37-a256-4d24-87ba-56b7ecf7b566 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-a12e3f37-a256-4d24-87ba-56b7ecf7b566 admin admin] Request method failure captured: Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Accept: application/json Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Accept-Encoding: gzip, deflate Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Connection: keep-alive Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Content-Length: 0 Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Host: 10.222.0.62 Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Openstack-Api-Version: compute 2.90 Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Openstack-System-Scope: None Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: User-Agent: python-novaclient Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Auth-Token: gAAAAABiza0SqCNgaUmOUIIz1ILc2o2JWZ-aJfy6BOFdaAO2NJBSRy_LuB3vuZszLMdqg2LLfT84GxkrFn3UeRBv0P0LppeN4FCUNaIccZrU4_eCokUROfNAc_P-9bh4GENIzJjHOL-08ZSsrq2V-fA11tnIdl_bn1UF0hnINOiNtlwxxmoO3ng Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Domain-Id: None Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Domain-Name: None Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Identity-Status: Confirmed Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Is-Admin-Project: True Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Project-Domain-Id: default Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Project-Domain-Name: Default Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Project-Id: 0b1c4bb3b2b9474ba67275ac784a1403 Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Project-Name: admin Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Role: admin,reader,member Jul 12 17:19:14.729253 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Roles: admin,reader,member Jul 12 17:19:14.730936 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0b1c4bb3b2b9474ba67275ac784a1403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0b1c4bb3b2b9474ba67275ac784a1403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0b1c4bb3b2b9474ba67275ac784a1403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0b1c4bb3b2b9474ba67275ac784a1403", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:19:14.730936 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Tenant: admin Jul 12 17:19:14.730936 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Tenant-Id: 0b1c4bb3b2b9474ba67275ac784a1403 Jul 12 17:19:14.730936 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-Tenant-Name: admin Jul 12 17:19:14.730936 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-User: admin Jul 12 17:19:14.730936 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-User-Domain-Id: default Jul 12 17:19:14.730936 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-User-Domain-Name: Default Jul 12 17:19:14.730936 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-User-Id: 95036fe6caa14165a48458f99b1674e5 Jul 12 17:19:14.730936 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: X-User-Name: admin Jul 12 17:19:14.730936 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: method: > Jul 12 17:19:14.730936 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: exception: Flavor 451 could not be found. Jul 12 17:19:14.730936 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: action_args: {'id': '451'} Jul 12 17:19:14.730936 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:19:14.730936 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:19:14.732069 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 17:19:14.732069 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 17:19:14.732069 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 17:19:14.732069 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 17:19:14.732069 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 17:19:14.732069 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 17:19:14.732069 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 17:19:14.732069 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 17:19:14.732069 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 17:19:14.732069 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:19:14.732069 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 17:19:14.732069 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 17:19:14.732069 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 17:19:14.732069 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Jul 12 17:19:14.732069 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:19:14.732069 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Jul 12 17:19:14.732069 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:19:14.732069 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:19:14.732069 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:19:14.733491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:19:14.733491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:19:14.733491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:19:14.733491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:19:14.733491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 17:19:14.733491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:19:14.733491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 17:19:14.733491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Jul 12 17:19:14.733491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:19:14.733491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Jul 12 17:19:14.733491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:19:14.733491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:19:14.733491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:19:14.733491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:19:14.733491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:19:14.733491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 17:19:14.733491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: ERROR nova.api.openstack.wsgi Jul 12 17:19:14.733491 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-a12e3f37-a256-4d24-87ba-56b7ecf7b566 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103178) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:19:14.735359 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-a12e3f37-a256-4d24-87ba-56b7ecf7b566 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012233 Jul 12 17:19:14.735359 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 27/52] 10.222.0.62 () {60 vars in 1193 bytes} [Tue Jul 12 17:19:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:15.689628 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-3610649c-10bf-4b4d-aae8-1d1c8ceb848c admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:15.690670 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-3610649c-10bf-4b4d-aae8-1d1c8ceb848c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 12 17:19:15.691075 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 26/53] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Jul 12 17:19:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:19:16.211352 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-fb8e59fa-0c7e-44df-ba8b-263e14512e92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:19:16.229059 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-fb8e59fa-0c7e-44df-ba8b-263e14512e92 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.400182 Jul 12 17:19:16.229593 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 28/54] 10.222.0.62 () {64 vars in 1235 bytes} [Tue Jul 12 17:19:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:19:17.196809 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-3610649c-10bf-4b4d-aae8-1d1c8ceb848c admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:17.197843 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-3610649c-10bf-4b4d-aae8-1d1c8ceb848c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Jul 12 17:19:17.198239 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 27/55] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Jul 12 17:19:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:19:17.708500 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-e174ad96-e0ab-4abc-a1a0-e355dd393530 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:19:17.726610 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-e174ad96-e0ab-4abc-a1a0-e355dd393530 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.392380 Jul 12 17:19:17.727143 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 29/56] 10.222.0.62 () {64 vars in 1235 bytes} [Tue Jul 12 17:19:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:19:18.686181 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-3610649c-10bf-4b4d-aae8-1d1c8ceb848c admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:18.687173 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-3610649c-10bf-4b4d-aae8-1d1c8ceb848c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 12 17:19:18.688173 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 28/57] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Jul 12 17:19:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:19:19.202997 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-faa6f852-5efe-4bfb-9f44-282003cd4a8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:19:19.220009 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-faa6f852-5efe-4bfb-9f44-282003cd4a8b admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.394291 Jul 12 17:19:19.220548 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 30/58] 10.222.0.62 () {64 vars in 1235 bytes} [Tue Jul 12 17:19:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:19:20.178532 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-3610649c-10bf-4b4d-aae8-1d1c8ceb848c admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:20.179545 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-3610649c-10bf-4b4d-aae8-1d1c8ceb848c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 12 17:19:20.179947 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 29/59] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Jul 12 17:19:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:19:20.696626 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-d74d2c8f-7207-4cb4-a77d-05440e7c991c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:19:20.714717 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-d74d2c8f-7207-4cb4-a77d-05440e7c991c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.396812 Jul 12 17:19:20.715249 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 31/60] 10.222.0.62 () {64 vars in 1235 bytes} [Tue Jul 12 17:19:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 17:19:21.677199 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-3610649c-10bf-4b4d-aae8-1d1c8ceb848c admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:21.678217 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-3610649c-10bf-4b4d-aae8-1d1c8ceb848c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 12 17:19:21.678614 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 30/61] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Jul 12 17:19:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:19:22.190773 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-67260ea8-a258-459e-b3e7-4d248e6c1c94 admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:19:22.209606 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-67260ea8-a258-459e-b3e7-4d248e6c1c94 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.392232 Jul 12 17:19:22.210160 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 32/62] 10.222.0.62 () {60 vars in 1202 bytes} [Tue Jul 12 17:19:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:20:13.342964 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-3610649c-10bf-4b4d-aae8-1d1c8ceb848c admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:20:13.343985 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-3610649c-10bf-4b4d-aae8-1d1c8ceb848c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 12 17:20:13.344373 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 31/63] 10.222.0.62 () {54 vars in 930 bytes} [Tue Jul 12 17:20:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:20:13.354920 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG dbcounter [-] [103178] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:13.739550 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-0d0a7a18-5310-49ab-ac33-d2f484e82e6f admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:20:13.758341 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-0d0a7a18-5310-49ab-ac33-d2f484e82e6f admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407783 Jul 12 17:20:13.758879 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 33/64] 10.222.0.62 () {60 vars in 1291 bytes} [Tue Jul 12 17:20:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:20:13.782571 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-e71a5b9f-b313-4b0c-b910-5df6c101ecb4 admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:20:13.786048 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG dbcounter [-] [103177] Writing DB stats nova_api:SELECT=14 {{(pid=103177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:13.791973 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-e71a5b9f-b313-4b0c-b910-5df6c101ecb4 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013569 Jul 12 17:20:13.792494 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 32/65] 10.222.0.62 () {60 vars in 1282 bytes} [Tue Jul 12 17:20:13 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:20:13.804271 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-acbe2c3c-26ab-4e62-8735-4250e863b7e0 admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:20:13.811709 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-acbe2c3c-26ab-4e62-8735-4250e863b7e0 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010978 Jul 12 17:20:13.812282 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 34/66] 10.222.0.62 () {60 vars in 1285 bytes} [Tue Jul 12 17:20:13 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:20:13.823548 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-679a6ce9-3798-4576-9e46-bef09e2d4eec admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:20:13.831369 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-679a6ce9-3798-4576-9e46-bef09e2d4eec admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011229 Jul 12 17:20:13.831872 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 33/67] 10.222.0.62 () {60 vars in 1285 bytes} [Tue Jul 12 17:20:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:20:13.842613 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-5d7e4fe4-c01d-4f39-9cb7-2a8c68793caa admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:20:13.850719 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-5d7e4fe4-c01d-4f39-9cb7-2a8c68793caa admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011505 Jul 12 17:20:13.851230 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 35/68] 10.222.0.62 () {60 vars in 1282 bytes} [Tue Jul 12 17:20:13 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:23:50.810159 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-679a6ce9-3798-4576-9e46-bef09e2d4eec admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:23:50.811173 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-679a6ce9-3798-4576-9e46-bef09e2d4eec admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jul 12 17:23:50.811572 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 34/69] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Jul 12 17:23:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:23:50.950999 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG dbcounter [-] [103178] Writing DB stats nova_api:SELECT=6 {{(pid=103178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:23:51.108990 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-b95b95ea-4510-476e-9887-e2507bc2cafc admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:23:51.110188 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:23:51.110188 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: warnings.warn(msg) Jul 12 17:23:51.111376 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_concurrency.lockutils [None req-b95b95ea-4510-476e-9887-e2507bc2cafc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:23:51.111806 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_concurrency.lockutils [None req-b95b95ea-4510-476e-9887-e2507bc2cafc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:23:51.112608 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_concurrency.lockutils [None req-b95b95ea-4510-476e-9887-e2507bc2cafc admin admin] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:23:51.113026 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_concurrency.lockutils [None req-b95b95ea-4510-476e-9887-e2507bc2cafc admin admin] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:23:51.146615 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-b95b95ea-4510-476e-9887-e2507bc2cafc admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.197084 Jul 12 17:23:51.147158 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 36/70] 10.222.0.62 () {60 vars in 1193 bytes} [Tue Jul 12 17:23:50 2022] GET /compute/v2.1/os-services => generated 791 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:23:51.974038 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-679a6ce9-3798-4576-9e46-bef09e2d4eec admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:23:51.975036 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-679a6ce9-3798-4576-9e46-bef09e2d4eec admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002045 Jul 12 17:23:51.975435 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 35/71] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Jul 12 17:23:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:23:52.163921 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-ed86addd-4c28-464c-aa35-db88bb59da50 admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:23:52.165075 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:23:52.165075 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: warnings.warn(msg) Jul 12 17:23:52.166261 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_concurrency.lockutils [None req-ed86addd-4c28-464c-aa35-db88bb59da50 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:23:52.166690 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_concurrency.lockutils [None req-ed86addd-4c28-464c-aa35-db88bb59da50 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:23:52.167458 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_concurrency.lockutils [None req-ed86addd-4c28-464c-aa35-db88bb59da50 admin admin] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:23:52.167892 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_concurrency.lockutils [None req-ed86addd-4c28-464c-aa35-db88bb59da50 admin admin] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:23:52.186733 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-ed86addd-4c28-464c-aa35-db88bb59da50 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073472 Jul 12 17:23:52.187210 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 37/72] 10.222.0.62 () {60 vars in 1193 bytes} [Tue Jul 12 17:23:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:24:03.406308 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-679a6ce9-3798-4576-9e46-bef09e2d4eec admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:24:03.407315 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-679a6ce9-3798-4576-9e46-bef09e2d4eec admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 12 17:24:03.407710 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 36/73] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Jul 12 17:24:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:24:03.550195 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG dbcounter [-] [103178] Writing DB stats nova_cell0:SELECT=4 {{(pid=103178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:24:03.550929 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG dbcounter [-] [103178] Writing DB stats nova_cell1:SELECT=4 {{(pid=103178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:24:03.551584 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG dbcounter [-] [103178] Writing DB stats nova_api:SELECT=8 {{(pid=103178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:24:03.599876 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-c5a2032d-aefe-4b33-8499-230e8053af6d admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:24:03.601020 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:24:03.601020 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: warnings.warn(msg) Jul 12 17:24:03.602229 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_concurrency.lockutils [None req-c5a2032d-aefe-4b33-8499-230e8053af6d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:24:03.602663 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_concurrency.lockutils [None req-c5a2032d-aefe-4b33-8499-230e8053af6d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:24:03.603441 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_concurrency.lockutils [None req-c5a2032d-aefe-4b33-8499-230e8053af6d admin admin] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:24:03.603864 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_concurrency.lockutils [None req-c5a2032d-aefe-4b33-8499-230e8053af6d admin admin] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:24:03.628722 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-c5a2032d-aefe-4b33-8499-230e8053af6d admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082902 Jul 12 17:24:03.629200 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 38/74] 10.222.0.62 () {60 vars in 1193 bytes} [Tue Jul 12 17:24:03 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:24:04.447994 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: DEBUG nova.api.openstack.wsgi [None req-679a6ce9-3798-4576-9e46-bef09e2d4eec admin admin] Calling method '>' {{(pid=103177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:24:04.448994 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: INFO nova.api.openstack.requestlog [None req-679a6ce9-3798-4576-9e46-bef09e2d4eec admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Jul 12 17:24:04.449396 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: [pid: 103177|app: 0|req: 37/75] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Jul 12 17:24:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:24:04.643793 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG nova.api.openstack.wsgi [None req-f5fe3258-dec9-417b-84b9-f9bd1bbdb5c9 admin admin] Calling method '>' {{(pid=103178) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:24:04.644975 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:24:04.644975 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: warnings.warn(msg) Jul 12 17:24:04.646822 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_concurrency.lockutils [None req-f5fe3258-dec9-417b-84b9-f9bd1bbdb5c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:24:04.647290 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_concurrency.lockutils [None req-f5fe3258-dec9-417b-84b9-f9bd1bbdb5c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:24:04.648067 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_concurrency.lockutils [None req-f5fe3258-dec9-417b-84b9-f9bd1bbdb5c9 admin admin] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:24:04.648486 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: DEBUG oslo_concurrency.lockutils [None req-f5fe3258-dec9-417b-84b9-f9bd1bbdb5c9 admin admin] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103178) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:24:04.669455 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: INFO nova.api.openstack.requestlog [None req-f5fe3258-dec9-417b-84b9-f9bd1bbdb5c9 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.075652 Jul 12 17:24:04.669962 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: [pid: 103178|app: 0|req: 39/76] 10.222.0.62 () {60 vars in 1193 bytes} [Tue Jul 12 17:24:04 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:25:02.131255 dv-cinder-849325-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 12 17:25:02.131570 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: Tue Jul 12 17:25:02 2022 - graceful shutdown triggered... Jul 12 17:25:02.132077 dv-cinder-849325-2-iscsi devstack@n-api.service[103177]: Gracefully killing worker 1 (pid: 103177)... Jul 12 17:25:02.134252 dv-cinder-849325-2-iscsi devstack@n-api.service[103178]: Gracefully killing worker 2 (pid: 103178)... Jul 12 17:25:03.132311 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: worker 1 buried after 1 seconds Jul 12 17:25:03.132847 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: worker 2 buried after 1 seconds Jul 12 17:25:03.132847 dv-cinder-849325-2-iscsi devstack@n-api.service[103176]: goodbye to uWSGI. Jul 12 17:25:03.133909 dv-cinder-849325-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 12 17:25:03.134474 dv-cinder-849325-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 12 17:25:03.137279 dv-cinder-849325-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 17:25:03.147582 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 17:25:03.150100 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 17:25:03 2022] *** Jul 12 17:25:03.150100 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 17:25:03.150100 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 17:25:03.150100 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: nodename: dv-cinder-849325-2-iscsi Jul 12 17:25:03.150100 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: machine: x86_64 Jul 12 17:25:03.150100 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: clock source: unix Jul 12 17:25:03.150100 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: pcre jit disabled Jul 12 17:25:03.150100 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: detected number of CPU cores: 4 Jul 12 17:25:03.150100 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: current working directory: / Jul 12 17:25:03.150100 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: detected binary path: /usr/bin/uwsgi-core Jul 12 17:25:03.150775 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: your processes number limit is 47680 Jul 12 17:25:03.150775 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: your memory page size is 4096 bytes Jul 12 17:25:03.150775 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: detected max file descriptor number: 2048 Jul 12 17:25:03.150775 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: lock engine: pthread robust mutexes Jul 12 17:25:03.150775 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: thunder lock: enabled Jul 12 17:25:03.150775 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 17:25:03.150775 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 17:25:03.197286 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: Python main interpreter initialized at 0x5601108ea9c0 Jul 12 17:25:03.197286 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: python threads support enabled Jul 12 17:25:03.197286 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: your server socket listen backlog is limited to 100 connections Jul 12 17:25:03.197286 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: your mercy for graceful operations on workers is 90 seconds Jul 12 17:25:03.197859 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 17:25:03.197859 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: *** Operational MODE: preforking *** Jul 12 17:25:03.198043 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: *** uWSGI is running in multiple interpreter mode *** Jul 12 17:25:03.198043 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: spawned uWSGI master process (pid: 117936) Jul 12 17:25:03.198250 dv-cinder-849325-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 17:25:03.198947 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: spawned uWSGI worker 1 (pid: 117938, cores: 1) Jul 12 17:25:03.199180 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: spawned uWSGI worker 2 (pid: 117939, cores: 1) Jul 12 17:25:03.199432 dv-cinder-849325-2-iscsi devstack@n-api.service[117936]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 17:25:03.856918 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 17:25:03.873399 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 17:25:05.049932 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 17:25:05.049932 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: from cryptography.utils import int_from_bytes Jul 12 17:25:05.050569 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 17:25:05.050569 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: from cryptography.utils import int_from_bytes Jul 12 17:25:05.057715 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 17:25:05.057715 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: from cryptography.utils import int_from_bytes Jul 12 17:25:05.058234 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 17:25:05.058234 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: from cryptography.utils import int_from_bytes Jul 12 17:25:07.365156 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 17:25:07.365851 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 17:25:07.365978 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 17:25:07.366332 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 17:25:07.366425 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 17:25:07.366506 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 17:25:07.366591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 17:25:07.366674 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 17:25:07.366959 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.367077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 17:25:07.367295 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.367428 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 17:25:07.367644 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.367763 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.367965 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.368072 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.368302 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.368428 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.368617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.368723 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.368941 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.369054 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.369260 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.369372 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.369589 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.369708 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.369874 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.369975 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.370193 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.370304 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.370518 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849325-2-iscsi {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.370618 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.370840 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.370933 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.371150 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.371253 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849325-2-iscsi {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.371462 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.371556 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.371780 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.371879 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.372086 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.372197 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.372410 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.372513 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.372729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.372831 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.373058 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.373224 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.373374 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.373657 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.373927 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.374073 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.374253 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.374399 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.374599 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.374715 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.374890 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.374998 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.375207 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.375307 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.375527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.375620 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.375834 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.375939 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.376157 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.376256 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.376466 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.376559 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.376796 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.376897 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849325-2-iscsi {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.377117 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.377270 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.377463 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.377664 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849325-2-iscsi {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.377833 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.377931 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.378175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.378268 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.378493 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.378639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.378800 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.378955 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.379122 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.379284 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.379444 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.379565 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.379751 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.379849 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.380076 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.380177 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.380393 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.380494 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.380710 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.380802 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.381029 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.381129 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.381330 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.381432 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.381637 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.381853 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.381973 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.382083 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.382297 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.382395 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.383126 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.383246 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.383433 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.383543 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.383681 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.383781 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.383987 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.384087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.384307 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.384415 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.384626 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.384715 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.384953 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.385097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.385287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.385622 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.385922 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.386021 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.386188 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.386290 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.386519 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.386612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.386843 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.386943 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.387160 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.387270 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.387486 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.387607 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.387829 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.387935 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.388111 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.388280 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.388435 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.388579 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.388748 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.388916 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.389063 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.389782 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.389970 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.390149 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.390470 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.390641 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.390808 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.390969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.391129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.391279 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.391583 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.391757 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.391872 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.391972 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.392060 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.392147 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.392238 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.392325 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.392441 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.392542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.392629 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.392721 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.392721 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.392891 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.392995 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.393088 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.393175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.393288 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.393447 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.393578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.393776 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.393881 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.394085 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.394191 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.394394 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.394502 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.394713 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.394815 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.395048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.395151 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.395355 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.395457 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.395605 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.395698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.395906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.395997 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.396210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.396316 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.396527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.396627 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.396833 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.396933 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.397140 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.397244 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.397444 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.397560 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.397770 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.397896 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.398100 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.398828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.398949 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.399052 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.399261 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.399369 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.399674 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.399825 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.399924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.400011 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.400165 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.400267 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.400478 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.400576 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.400794 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.400886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.401099 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.401198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.401419 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.401513 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.401762 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.401858 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.402073 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.402181 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.402379 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.402483 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.402684 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.402778 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.402988 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.403093 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.403313 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.403404 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.403642 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.403747 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.403921 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.404025 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.404242 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.404335 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.404548 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.404641 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.404852 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.404955 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.405170 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.405284 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.405475 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.405600 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.405802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.405914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.406122 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.406226 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.406424 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.406524 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.406729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.406836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.407046 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.407138 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.407351 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.407450 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.407655 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.407764 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.407962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.408128 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.408262 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.408355 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.408564 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.408657 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.408867 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.408961 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.409170 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.409268 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.409473 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.409574 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.409794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.409890 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.410115 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.410208 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.410436 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.410536 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.410744 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.410844 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.411051 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.411143 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.411354 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.411454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.411671 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.411771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:25:07.412007 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.412114 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.412340 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.412440 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.412688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.412829 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.413013 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.413159 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.413355 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.413582 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.413842 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.413964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.414085 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.414242 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.414363 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.414566 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.414700 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.414874 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.415062 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.415183 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.415305 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.415501 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.415628 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.415813 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.415942 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.416126 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.416255 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.416444 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.416571 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.416762 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.416890 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.417089 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.417217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.417405 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.417532 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.417789 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.421894 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.422106 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.422279 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.422436 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.422601 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.422762 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.422913 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.423076 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.423234 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.423383 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.423549 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.423698 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.423864 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.424012 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.424167 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.424314 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.424469 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.424615 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.424772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.424926 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.425074 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.425219 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.425375 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.425520 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.425711 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.425881 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.425881 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.426177 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.426323 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.426469 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.426628 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.426776 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.426922 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.427067 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.427214 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.427390 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.427545 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.427736 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.427888 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.428035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.428181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.428637 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.428801 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.428950 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.429096 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.429250 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.429403 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.429578 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.430099 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.430303 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.430502 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.430692 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.430881 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.431080 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.431263 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.431443 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.431626 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.431896 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.432103 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.432425 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.432619 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.432814 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.433004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.433186 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.433384 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.433566 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.433760 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.433926 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.434084 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.434239 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.434400 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.434548 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.434694 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.434857 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.435012 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.435168 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.435328 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.435476 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.435628 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.435782 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.435928 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.436082 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.436239 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.436386 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.436539 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.436694 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.436850 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.437006 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.437161 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.437316 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.437469 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.437623 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.437877 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.437877 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.438181 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.438181 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.438681 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.438681 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.439059 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.439227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.439385 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.439531 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.439678 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.439831 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.440004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.440229 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.440401 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.440639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.440790 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.440946 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.441103 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.441250 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.441409 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.441563 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.441743 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.441895 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.442150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.442303 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.442497 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.442655 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.442811 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.442965 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.443127 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.443274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.443435 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.443591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.443747 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.443901 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.444059 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.444206 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.444360 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.444507 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.444699 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.444863 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.445506 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.445663 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.445835 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.446003 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.446158 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.446314 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.446462 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.446607 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.447025 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.447182 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.447479 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.447647 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.447805 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.447963 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.448109 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.448256 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.448420 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.448824 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.449073 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.449235 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.449392 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.449547 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.449734 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.449887 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.450046 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.450210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.450437 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.450591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.450844 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.451010 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.451010 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.451304 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.451304 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.451588 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.451749 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.451897 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.452062 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.452300 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.452452 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.452606 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.452767 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.452925 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.452925 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.453221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.453368 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.453527 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.453675 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.453907 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.454056 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.454210 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.454358 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.454514 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.454668 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.454822 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.454981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.455128 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.455281 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.455437 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.455592 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.455739 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.455885 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.456031 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.456177 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.456333 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.456486 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.456633 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.456779 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.456935 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.457088 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.457246 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.457403 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.457639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.457810 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.457968 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.458125 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.458273 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.458419 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.458565 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.458855 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.459013 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.459278 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.459439 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.459587 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.459734 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.459879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.460025 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.460179 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.460327 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.460561 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.461380 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.461628 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.461815 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.461976 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.462145 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.462310 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.462535 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.462687 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.462844 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.462991 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.463137 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.463283 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.463430 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.463584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.463741 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.463896 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.464051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.464223 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.464223 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.464514 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.464669 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.464816 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.464961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.465113 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.465113 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.465389 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.465389 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.465721 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.465874 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.466169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.466357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.466542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.466703 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.466866 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.467013 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.467167 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.467313 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.467474 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.467649 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.467873 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.468032 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.468181 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.468338 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.468495 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.468642 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.468796 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.469083 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.469236 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.469481 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.469643 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.469814 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.469963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.471789 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.471963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.472137 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.472312 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.472470 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.472804 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.472968 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.473118 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.473274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.473430 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.473584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.473758 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.473921 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.474070 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.474230 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.474378 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.474534 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.474680 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.474825 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.474972 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.475131 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.475286 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.475432 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.475585 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.475738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.475898 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.476056 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.476227 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.476386 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.476553 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.476707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.476890 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.477620 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.477857 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.478099 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.478267 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.478422 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.478590 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.478753 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.478908 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.479208 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.479393 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.479652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.479826 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.479981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.480135 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.480288 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.480449 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.480610 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.480779 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.480958 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.481186 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.481354 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.481517 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.481716 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.481876 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.482041 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.482041 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.482358 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.482510 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.482920 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.483086 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.483250 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.483406 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.483561 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.483721 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.483890 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.484063 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.484217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.484414 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.484580 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.484742 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.484906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.485068 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.485240 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.485404 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.485560 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.485560 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.485909 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.486086 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.486240 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.486394 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.486558 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.486725 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.486879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.487033 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.487194 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.487194 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.487493 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.487493 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.487795 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.487956 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.488751 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.488920 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.489091 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.489402 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.489573 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.489573 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.490016 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.490181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.490344 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.490499 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.490661 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.490823 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.490988 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.491180 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.491404 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.491669 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.491920 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.492123 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.492321 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.492511 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.492511 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.493091 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.493296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.493494 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.493666 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.493854 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.494031 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.494195 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.494350 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.494504 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.494657 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.494811 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.494975 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.495138 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.495292 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.495542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.495732 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.495930 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.496141 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.496341 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.496538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.496727 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.496915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.497106 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.497308 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.497498 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.497763 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.497953 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.498111 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.498266 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.498437 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.498604 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.498794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.499020 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.499020 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.499361 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.499361 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.499833 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.500082 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.500242 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.500444 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.500617 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.500781 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.500943 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.501116 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.501280 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.501528 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.501721 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.501891 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.502062 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.502220 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.502383 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.502547 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.502718 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.502873 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.503043 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.503362 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.503533 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.503698 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.503854 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.504015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.504182 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.504338 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.504493 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.504656 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.504819 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.504981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.505143 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.505297 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.505463 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.505630 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.505843 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.506011 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.506174 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.506327 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.506490 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.506658 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.506814 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.506974 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.507137 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.507299 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.507976 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.508156 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.508319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.508479 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.508644 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.508843 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.509070 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.509306 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.509306 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.509773 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.509935 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.510118 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.510370 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.510532 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.510700 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.510854 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.511015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.511169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.511169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.511472 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.511717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.511885 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.512040 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.512214 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.512214 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.512507 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.512668 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.512842 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.512996 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.513159 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.513330 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.513658 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.513846 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.514011 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.514164 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.514333 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.514495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.514660 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.514823 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.514996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.515158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.515322 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.515476 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.515629 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.515790 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.515953 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.516121 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.516277 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.516437 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.516617 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.517364 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.517531 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.517813 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.517985 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.518148 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.518310 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.518464 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.518618 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.518781 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.518936 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.519091 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.519245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.519494 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.519662 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.519983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.520152 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.520306 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.520566 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.520734 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.520909 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.521078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.521241 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.521395 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.521557 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.521768 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.522006 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.522175 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.522330 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.522496 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.522659 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.522822 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.522986 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.523884 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.524056 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.524221 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.524386 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.524540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.524708 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.524871 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.525034 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.525190 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.525190 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.525510 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.525666 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.525877 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.526032 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.526187 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.526341 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.526579 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.526736 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.526898 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.527059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.527228 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.527404 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.527569 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.527730 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.527883 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.528035 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.528189 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.528349 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.528519 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.528680 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.528833 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.528986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.529146 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.529307 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.529649 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.530014 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.530187 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.530342 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.530497 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.530762 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.530931 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.531093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.531249 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.531402 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.531563 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.531731 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.531901 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.532158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.532158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.532456 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.532618 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.532785 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.532958 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.533205 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.533380 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.533536 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.533708 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.533896 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.534129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.534395 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.534566 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.534721 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.534886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.535041 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.535194 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.535347 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.535501 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.535655 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.535819 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.535982 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.536145 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.536308 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.536308 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.536624 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.536624 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.536938 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.537092 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.537245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.537399 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.537553 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.537816 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.537978 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.538133 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.538299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.538764 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.538948 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.539113 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.539268 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.539430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.539593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.539846 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.540764 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.541035 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.541206 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.541369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.541531 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.541701 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.541881 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.542050 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.544811 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.544989 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.545122 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.545242 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.545369 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.545486 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.545600 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.546027 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.546195 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.546370 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.546536 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.546691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.546866 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.547022 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.547022 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.547340 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.547504 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.547665 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.547665 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.547958 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.548120 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.548288 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.548446 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.548599 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.548764 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.548918 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.549080 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.549248 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.549410 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.549566 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.549764 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.550011 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.550448 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.550619 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.550863 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.551042 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.551281 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.551454 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.551621 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.551776 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.551931 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.552091 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.552091 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.552403 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.552574 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.552737 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.552907 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.553075 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.553239 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.553394 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.553558 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.553762 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.553923 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.554078 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.554333 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.554497 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.554893 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.555061 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.555224 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.555389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.555389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.555703 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.555703 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.556072 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.556235 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.556406 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.556562 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.556724 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.556879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.557039 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.557201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.557371 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.557535 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.557716 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.557887 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.558055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.558217 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.558383 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.558546 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.558709 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.558868 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.559031 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.559186 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.559354 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.559509 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.559509 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.559801 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.559963 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.560236 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.560415 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.560637 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.560796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.561038 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.561199 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.561474 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.561642 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.561769 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.561908 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.561995 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.562096 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.562190 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.562282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.562368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.562459 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.562560 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.562651 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.562742 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.562825 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.562900 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.562973 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.563054 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.563137 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.563212 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.563292 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.563367 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.563447 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.563529 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.563616 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.563692 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.563780 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.563862 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.563943 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.564019 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.564110 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.564194 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.564269 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.564349 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.564431 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.564506 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.564593 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.564676 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.564757 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.565094 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.565184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.565270 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.565345 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.565419 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.565499 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.565585 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.565658 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.565810 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.565896 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.565896 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.566039 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.566112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.566191 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.566274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.566349 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.566513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.566594 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.566676 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.566751 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.566837 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.566920 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.566994 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.567075 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.567149 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.567235 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.567310 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.567383 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.567455 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.567535 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.567615 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.567704 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.567779 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.567852 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.567932 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.568015 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.568096 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.568179 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.568254 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.568326 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.568407 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.568489 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.568563 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.568650 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.568731 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.568806 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.568878 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.568957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.569044 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.569127 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.569207 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.569290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.569365 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.569437 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.569518 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.569599 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.569673 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.569767 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.569841 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.570451 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.580772 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.580877 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.580967 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.581045 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.581128 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.581211 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.581304 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.581388 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.581463 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.581463 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.581611 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.581712 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.581792 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.581866 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.581951 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.582026 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.582106 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.582106 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.582257 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.582339 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.582421 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.582502 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.582576 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.582661 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.582741 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.582824 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.582926 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.583003 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.583084 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.583171 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.583246 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.583246 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.583378 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.583450 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.583532 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.583614 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.583711 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.583787 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.583860 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.583933 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.584015 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.584091 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.584165 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.584245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.584321 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.584401 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.584560 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.584644 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.584725 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.584799 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.584879 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.584961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.585044 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.585119 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.585198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.585279 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.585356 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.585438 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.585521 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.585652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.588851 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.588958 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.589049 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.589135 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.589135 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.589284 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.589359 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.589440 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.589524 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.589606 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.589606 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.589779 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.589779 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.589779 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.589779 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.589779 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.589779 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.590190 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.590266 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.590348 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.590423 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.590504 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.590585 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.590659 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.590731 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.590817 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.590900 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.590976 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.591048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.591128 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.591220 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.591308 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.591390 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.591464 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.591537 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.591618 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.591701 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.591782 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.591857 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.591936 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.592010 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.592081 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.592167 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.592248 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.592337 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.592412 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.592491 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.592571 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.592658 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.592740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.592834 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.592917 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.592991 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.593077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.593152 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.593232 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.593306 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.593379 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.593458 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.593551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.593627 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.593757 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.593837 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.593923 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.594013 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.594103 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.594186 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.594262 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.594335 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.594409 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.594489 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.594573 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.594647 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.594722 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.594795 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.594868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.594949 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.595031 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.595112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.595194 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.595274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.595274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.595415 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.595499 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.595574 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.595648 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.595721 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.595792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.595879 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.595954 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.596027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.596100 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.596180 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.596260 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.596365 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.596484 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.596570 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.596652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.596741 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.596825 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.596914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.597021 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.597021 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.597167 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.597242 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.597332 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.597408 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.597482 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.597562 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.597637 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.597738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.597826 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.597909 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.597991 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.598066 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.598140 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.598222 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.598310 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.598385 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.598458 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.598538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.598613 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.598694 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.598782 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.598857 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.598931 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.599003 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.599076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.599159 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.599234 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.599307 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.599380 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.599466 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.599539 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.599622 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.599704 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.599779 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.599852 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.599932 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.600006 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.600089 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.600172 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.600247 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.600320 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.600392 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.600474 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.600550 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.600623 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.600706 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.600791 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.600869 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.600955 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.601031 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.601104 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.601198 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.601277 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.601352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.601439 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.601521 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.601602 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.601698 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.609331 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.609331 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.609504 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.609586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.609670 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.609782 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.609859 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.610020 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.610105 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.610187 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.610262 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.610342 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.610416 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.610416 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.610566 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.610641 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.610714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.610794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.610876 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.610959 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.611045 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.611181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.611268 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.611350 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.611434 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.611516 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.611598 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.611678 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.611753 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.611826 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.611909 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.611992 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.612141 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.612230 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.612230 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.612378 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.612463 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.612539 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.612618 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.612692 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.612777 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.612853 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.612935 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.612935 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.613076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.613158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.613245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.613327 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.613409 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.613490 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.613565 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.613637 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.615960 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.616105 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.616229 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.616311 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.616395 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.616484 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.616571 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.616666 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.616744 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.617346 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.617426 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.617509 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.617600 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.617600 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.618207 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.618298 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.618385 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.618385 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.618555 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.618555 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.618716 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.618716 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.618872 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.618872 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.619016 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.619099 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.619174 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.619255 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.619330 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.619330 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.619478 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.619552 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.619625 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.619698 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.619771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.619852 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.619934 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.620008 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.620081 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.620154 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.620242 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.620324 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.620406 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.620487 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.620568 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.620642 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.620721 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.620808 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.620808 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.620943 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.621015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.621108 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.621194 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.621276 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.621350 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.621524 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.621603 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.621699 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.621804 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.621893 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.621987 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.622062 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.622135 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.622221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.622308 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.622384 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.622464 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.622538 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.622610 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.622610 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.622782 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.622875 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.622970 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.623057 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.623138 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.623138 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.623295 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.623376 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.623449 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.623534 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.623620 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.623710 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.623793 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.623867 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.623952 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.624044 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.624044 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.624044 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.624044 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.624044 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.624044 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.624508 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.624609 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.624702 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.624789 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.624874 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.624962 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.625048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.625147 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.625147 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.625312 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.625397 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.625478 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.625563 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.625660 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.625838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.625838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.626008 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.626102 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.626192 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.626192 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.626192 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.626192 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.626192 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.626192 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.626192 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.626192 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.626761 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.626761 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.626761 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.626761 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.626761 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.626761 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.626761 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.626761 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.627357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.627357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.627357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.627357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.627357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.627357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.627357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.627357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.627994 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.627994 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.627994 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.627994 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.627994 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.627994 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.628538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.628538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.628694 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.629440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.629440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.629670 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.630096 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.630433 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.630755 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.631073 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.631387 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.631672 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 17:25:07.634316 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.634664 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.635470 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.635470 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.635800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.636050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.636651 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.636987 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.637315 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.637639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.638117 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.638597 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.639031 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.639400 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.639603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.639944 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.640774 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.641226 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.641585 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.641962 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.642290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.642704 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.643032 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.643696 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.645058 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.645519 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.645778 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.646112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.646548 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.646901 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.647257 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.647600 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.648113 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.648791 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.649154 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.649483 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.649854 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.650182 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.650504 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.650857 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.651181 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.651505 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.651832 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.652160 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.652503 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.652838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.653157 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.653491 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.653871 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.654241 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.654626 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.654917 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.655284 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.655609 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.655931 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.656244 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:25:07.656495 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 17:25:07.785280 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO dbcounter [None req-e8f76654-4a0f-49f5-bd18-1ac0e51cd21c None None] Registered counter for database nova_api Jul 12 17:25:07.805374 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_db.sqlalchemy.engines [None req-e8f76654-4a0f-49f5-bd18-1ac0e51cd21c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:25:07.808665 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO dbcounter [None req-5e522d76-3625-4d96-acca-bcdf68201d83 None None] Registered counter for database nova_api Jul 12 17:25:07.812776 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writer thread running {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:25:07.828716 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_db.sqlalchemy.engines [None req-5e522d76-3625-4d96-acca-bcdf68201d83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:25:07.835554 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writer thread running {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:25:07.869589 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.context [None req-e8f76654-4a0f-49f5-bd18-1ac0e51cd21c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),38cb94f1-249d-4d6f-82ce-acee8cef23f0(cell1) {{(pid=117938) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 17:25:07.873746 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e8f76654-4a0f-49f5-bd18-1ac0e51cd21c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:25:07.875361 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e8f76654-4a0f-49f5-bd18-1ac0e51cd21c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:25:07.876178 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e8f76654-4a0f-49f5-bd18-1ac0e51cd21c None None] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:25:07.878347 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e8f76654-4a0f-49f5-bd18-1ac0e51cd21c None None] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:25:07.880355 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO dbcounter [None req-e8f76654-4a0f-49f5-bd18-1ac0e51cd21c None None] Registered counter for database nova_cell0 Jul 12 17:25:07.885048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO dbcounter [None req-e8f76654-4a0f-49f5-bd18-1ac0e51cd21c None None] Registered counter for database nova_cell1 Jul 12 17:25:07.893185 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.context [None req-5e522d76-3625-4d96-acca-bcdf68201d83 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),38cb94f1-249d-4d6f-82ce-acee8cef23f0(cell1) {{(pid=117939) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 17:25:07.893375 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_db.sqlalchemy.engines [None req-e8f76654-4a0f-49f5-bd18-1ac0e51cd21c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:25:07.894487 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_db.sqlalchemy.engines [None req-e8f76654-4a0f-49f5-bd18-1ac0e51cd21c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:25:07.895713 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e522d76-3625-4d96-acca-bcdf68201d83 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:25:07.897327 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e522d76-3625-4d96-acca-bcdf68201d83 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:25:07.898211 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e522d76-3625-4d96-acca-bcdf68201d83 None None] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:25:07.899662 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writer thread running {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:25:07.900278 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e522d76-3625-4d96-acca-bcdf68201d83 None None] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:25:07.902206 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO dbcounter [None req-5e522d76-3625-4d96-acca-bcdf68201d83 None None] Registered counter for database nova_cell0 Jul 12 17:25:07.906428 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO dbcounter [None req-5e522d76-3625-4d96-acca-bcdf68201d83 None None] Registered counter for database nova_cell1 Jul 12 17:25:07.913517 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_db.sqlalchemy.engines [None req-5e522d76-3625-4d96-acca-bcdf68201d83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:25:07.916175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_db.sqlalchemy.engines [None req-5e522d76-3625-4d96-acca-bcdf68201d83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:25:07.920802 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writer thread running {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:25:07.923410 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writer thread running {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:25:08.037708 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writer thread running {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:25:08.048347 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO dbcounter [None req-e8f76654-4a0f-49f5-bd18-1ac0e51cd21c None None] Registered counter for database nova_cell0 Jul 12 17:25:08.055739 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_db.sqlalchemy.engines [None req-e8f76654-4a0f-49f5-bd18-1ac0e51cd21c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:25:08.060166 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writer thread running {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:25:08.069735 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO dbcounter [None req-5e522d76-3625-4d96-acca-bcdf68201d83 None None] Registered counter for database nova_cell0 Jul 12 17:25:08.076367 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_db.sqlalchemy.engines [None req-5e522d76-3625-4d96-acca-bcdf68201d83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:25:08.080707 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writer thread running {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:25:08.382985 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: WARNING keystonemiddleware.auth_token [None req-e8f76654-4a0f-49f5-bd18-1ac0e51cd21c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 17:25:08.390255 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: WARNING keystonemiddleware.auth_token [None req-e8f76654-4a0f-49f5-bd18-1ac0e51cd21c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 17:25:08.398650 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: WARNING keystonemiddleware.auth_token [None req-5e522d76-3625-4d96-acca-bcdf68201d83 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 17:25:08.405921 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: WARNING keystonemiddleware.auth_token [None req-5e522d76-3625-4d96-acca-bcdf68201d83 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 17:25:08.737517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: WARNING keystonemiddleware.auth_token [None req-e8f76654-4a0f-49f5-bd18-1ac0e51cd21c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 17:25:08.743793 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: WARNING keystonemiddleware.auth_token [None req-e8f76654-4a0f-49f5-bd18-1ac0e51cd21c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 17:25:08.752345 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5601108ea9c0 pid: 117938 (default app) Jul 12 17:25:08.752496 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: WARNING keystonemiddleware.auth_token [None req-5e522d76-3625-4d96-acca-bcdf68201d83 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 17:25:08.755401 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: WARNING keystonemiddleware.auth_token [None req-5e522d76-3625-4d96-acca-bcdf68201d83 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 17:25:08.761440 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5601108ea9c0 pid: 117939 (default app) Jul 12 17:25:48.703968 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:25:48.706096 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:25:48.707562 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:25:48.708852 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:25:49.588066 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=3 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:25:49.589490 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=3 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:25:49.590722 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=3 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:25:49.592519 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=3 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:25:49.797236 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1ab43d04-042f-4318-ab4a-947de9821c0d tempest-VolumesGetTestJSON-2010531241 tempest-VolumesGetTestJSON-2010531241-project] Action: 'create', calling method: .version_select at 0x7f872b8de5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-693028695", "metadata": {"Type": "work"}}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:25:50.573741 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cdb9f414-948e-4380-a031-f1d24288d3fb tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Action: 'create', calling method: .version_select at 0x7f872b8dd5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1548485198"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:25:50.750415 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1ab43d04-042f-4318-ab4a-947de9821c0d tempest-VolumesGetTestJSON-2010531241 tempest-VolumesGetTestJSON-2010531241-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.068438 Jul 12 17:25:50.751561 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 1/1] 10.222.0.62 () {60 vars in 1155 bytes} [Tue Jul 12 17:25:48 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2071 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 17:25:50.764603 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-92a07ba2-b129-4e4a-92e9-e183e43694d8 tempest-VolumesGetTestJSON-2010531241 tempest-VolumesGetTestJSON-2010531241-project] Calling method '.version_select at 0x7f872b7a4550>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:25:50.854980 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-92a07ba2-b129-4e4a-92e9-e183e43694d8 tempest-VolumesGetTestJSON-2010531241 tempest-VolumesGetTestJSON-2010531241-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/4f4130f0-610a-48e3-9ea7-521fe4488f01" status: 200 len: 352 microversion: 2.1 time: 0.094903 Jul 12 17:25:50.855661 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 2/2] 10.222.0.62 () {58 vars in 1244 bytes} [Tue Jul 12 17:25:50 2022] GET /compute/v2.1/os-volumes/4f4130f0-610a-48e3-9ea7-521fe4488f01 => generated 352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:25:51.587829 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fe5bd353-a374-43c3-ba17-63aa0c0b4db6 tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] Calling method '.version_select at 0x7f872b7a48b0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:25:51.610185 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-cdb9f414-948e-4380-a031-f1d24288d3fb tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.028182 Jul 12 17:25:51.611388 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 1/3] 10.222.0.62 () {60 vars in 1154 bytes} [Tue Jul 12 17:25:49 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2031 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 17:25:51.625961 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-631ae2d0-eada-45c4-9003-5df29b3a4819 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Calling method '.version_select at 0x7f872b7a64c0>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:25:51.706631 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fe5bd353-a374-43c3-ba17-63aa0c0b4db6 tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/f7c39939-511b-4452-9ced-7d49cb9b266f" status: 200 len: 348 microversion: 2.1 time: 0.123773 Jul 12 17:25:51.708489 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 3/4] 10.222.0.62 () {58 vars in 1244 bytes} [Tue Jul 12 17:25:51 2022] GET /compute/v2.1/os-volumes/f7c39939-511b-4452-9ced-7d49cb9b266f => generated 348 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:25:51.813075 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-631ae2d0-eada-45c4-9003-5df29b3a4819 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/9bca82fb-f67e-4ed3-bbe2-c110382c2811" status: 200 len: 345 microversion: 2.1 time: 0.191737 Jul 12 17:25:51.814150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 2/5] 10.222.0.62 () {58 vars in 1244 bytes} [Tue Jul 12 17:25:51 2022] GET /compute/v2.1/os-volumes/9bca82fb-f67e-4ed3-bbe2-c110382c2811 => generated 345 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:25:51.869180 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-463c2293-590a-47e7-bd44-f9f1c941f179 tempest-VolumesGetTestJSON-2010531241 tempest-VolumesGetTestJSON-2010531241-project] Calling method '.version_select at 0x7f872b7a4d30>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:25:51.958302 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-463c2293-590a-47e7-bd44-f9f1c941f179 tempest-VolumesGetTestJSON-2010531241 tempest-VolumesGetTestJSON-2010531241-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/4f4130f0-610a-48e3-9ea7-521fe4488f01" status: 200 len: 353 microversion: 2.1 time: 0.093938 Jul 12 17:25:51.973837 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 4/6] 10.222.0.62 () {58 vars in 1244 bytes} [Tue Jul 12 17:25:51 2022] GET /compute/v2.1/os-volumes/4f4130f0-610a-48e3-9ea7-521fe4488f01 => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:25:51.977487 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6113e1c4-addc-4aa9-941a-154e66411d74 tempest-VolumesGetTestJSON-2010531241 tempest-VolumesGetTestJSON-2010531241-project] Calling method '.version_select at 0x7f872b7a6700>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:25:52.080927 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6113e1c4-addc-4aa9-941a-154e66411d74 tempest-VolumesGetTestJSON-2010531241 tempest-VolumesGetTestJSON-2010531241-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/4f4130f0-610a-48e3-9ea7-521fe4488f01" status: 200 len: 353 microversion: 2.1 time: 0.111877 Jul 12 17:25:52.081810 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 3/7] 10.222.0.62 () {58 vars in 1244 bytes} [Tue Jul 12 17:25:51 2022] GET /compute/v2.1/os-volumes/4f4130f0-610a-48e3-9ea7-521fe4488f01 => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:25:52.099395 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a5e0a7fa-0133-457e-812d-5189322c0403 tempest-VolumesGetTestJSON-2010531241 tempest-VolumesGetTestJSON-2010531241-project] Calling method '.version_select at 0x7f872b7bc430>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:25:52.216725 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a5e0a7fa-0133-457e-812d-5189322c0403 tempest-VolumesGetTestJSON-2010531241 tempest-VolumesGetTestJSON-2010531241-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/4f4130f0-610a-48e3-9ea7-521fe4488f01" status: 202 len: 0 microversion: 2.1 time: 0.121507 Jul 12 17:25:52.217398 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 5/8] 10.222.0.62 () {58 vars in 1247 bytes} [Tue Jul 12 17:25:52 2022] DELETE /compute/v2.1/os-volumes/4f4130f0-610a-48e3-9ea7-521fe4488f01 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:25:52.228010 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1b675ab8-69c6-4a3b-812b-6f7d65f75ab8 tempest-VolumesGetTestJSON-2010531241 tempest-VolumesGetTestJSON-2010531241-project] Calling method '.version_select at 0x7f872b7a6ca0>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:25:52.308593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1b675ab8-69c6-4a3b-812b-6f7d65f75ab8 tempest-VolumesGetTestJSON-2010531241 tempest-VolumesGetTestJSON-2010531241-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/4f4130f0-610a-48e3-9ea7-521fe4488f01" status: 200 len: 352 microversion: 2.1 time: 0.086015 Jul 12 17:25:52.309342 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 4/9] 10.222.0.62 () {58 vars in 1244 bytes} [Tue Jul 12 17:25:52 2022] GET /compute/v2.1/os-volumes/4f4130f0-610a-48e3-9ea7-521fe4488f01 => generated 352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:25:52.826918 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-610a52da-423e-482c-87bd-100acdcb846e tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Calling method '.version_select at 0x7f872b7a4d30>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:25:52.942142 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-610a52da-423e-482c-87bd-100acdcb846e tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/9bca82fb-f67e-4ed3-bbe2-c110382c2811" status: 200 len: 346 microversion: 2.1 time: 0.119920 Jul 12 17:25:52.943232 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 6/10] 10.222.0.62 () {58 vars in 1244 bytes} [Tue Jul 12 17:25:52 2022] GET /compute/v2.1/os-volumes/9bca82fb-f67e-4ed3-bbe2-c110382c2811 => generated 346 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:25:52.955510 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a5c08d30-334c-481f-8c6b-db0fc6d7efdd tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Action: 'create', calling method: .version_select at 0x7f872b7be310>, body: {"snapshot": {"volume_id": "9bca82fb-f67e-4ed3-bbe2-c110382c2811", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1625540057"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:25:53.321596 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2e2004b3-8e91-4a3a-af86-5b81c87d28e3 tempest-VolumesGetTestJSON-2010531241 tempest-VolumesGetTestJSON-2010531241-project] Calling method '.version_select at 0x7f872b7a4af0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:25:53.622774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-2e2004b3-8e91-4a3a-af86-5b81c87d28e3 tempest-VolumesGetTestJSON-2010531241 tempest-VolumesGetTestJSON-2010531241-project] HTTP exception thrown: Volume 4f4130f0-610a-48e3-9ea7-521fe4488f01 could not be found. Jul 12 17:25:53.630112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2e2004b3-8e91-4a3a-af86-5b81c87d28e3 tempest-VolumesGetTestJSON-2010531241 tempest-VolumesGetTestJSON-2010531241-project] Request method failure captured: Jul 12 17:25:53.630112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/os-volumes/4f4130f0-610a-48e3-9ea7-521fe4488f01 HTTP/1.1 Jul 12 17:25:53.630112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:25:53.630112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:25:53.630112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:25:53.630112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:25:53.630112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:25:53.630112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:25:53.630112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:25:53.630112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:25:53.630112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza6cT8pyBcUqFQC0uyEbWRSIVVta_mb3Pt2AsIr7icdZoNUgyi5kjhSqqvsSHtfYui-AJfS9y9bXHOL4mDMot3mnMlHGtIfnqwGpzOFyFSuxaw5tdQuH4TPiIgg8Y1LvUEtqJ5Ls1uCu0EYowBlNPNe-sHGEX62LixcQx1LXzTnUGGc Jul 12 17:25:53.630112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:25:53.630112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:25:53.630112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:25:53.630112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:25:53.630112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:25:53.630112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:25:53.630112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: d5830af2c2c446bf88604b03152bc6c5 Jul 12 17:25:53.630112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesGetTestJSON-2010531241 Jul 12 17:25:53.630112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:25:53.630112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:25:53.631652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d5830af2c2c446bf88604b03152bc6c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d5830af2c2c446bf88604b03152bc6c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d5830af2c2c446bf88604b03152bc6c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d5830af2c2c446bf88604b03152bc6c5", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:25:53.631652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesGetTestJSON-2010531241 Jul 12 17:25:53.631652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: d5830af2c2c446bf88604b03152bc6c5 Jul 12 17:25:53.631652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesGetTestJSON-2010531241 Jul 12 17:25:53.631652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesGetTestJSON-2010531241-project Jul 12 17:25:53.631652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:25:53.631652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:25:53.631652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: b6614986536d436ea61d4a469652c46b Jul 12 17:25:53.631652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesGetTestJSON-2010531241-project Jul 12 17:25:53.631652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: Jul 12 17:25:53.631652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Volume 4f4130f0-610a-48e3-9ea7-521fe4488f01 could not be found. Jul 12 17:25:53.631652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': '4f4130f0-610a-48e3-9ea7-521fe4488f01'} Jul 12 17:25:53.631652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:25:53.633015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:25:53.633015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:25:53.633015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:25:53.633015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 17:25:53.633015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 17:25:53.633015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 17:25:53.633015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 17:25:53.633015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 17:25:53.633015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 17:25:53.633015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 17:25:53.633015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 17:25:53.633015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:25:53.633015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:25:53.633015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:25:53.633015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:25:53.633015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f4130f0-610a-48e3-9ea7-521fe4488f01 could not be found. (HTTP 404) (Request-ID: req-a94411d1-6aa3-442a-955c-5eb3e0fee534) Jul 12 17:25:53.633015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:25:53.633015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:25:53.633015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:25:53.634274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:25:53.634274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 17:25:53.634274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 17:25:53.634274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 17:25:53.634274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 17:25:53.634274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 17:25:53.634274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 17:25:53.634274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 17:25:53.634274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 17:25:53.634274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:25:53.634274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:25:53.634274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 17:25:53.634274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 17:25:53.634274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 17:25:53.634274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 17:25:53.634274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 17:25:53.634274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 17:25:53.634274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 17:25:53.634274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 17:25:53.635540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:25:53.635540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:25:53.635540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:25:53.635540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:25:53.635540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f4130f0-610a-48e3-9ea7-521fe4488f01 could not be found. Jul 12 17:25:53.635540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:25:53.635540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:25:53.635540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:25:53.635540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:25:53.635540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:25:53.635540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:25:53.635540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:25:53.635540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:25:53.635540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:25:53.635540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:25:53.635540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:25:53.635540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:25:53.635540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 17:25:53.635540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:25:53.638184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f4130f0-610a-48e3-9ea7-521fe4488f01 could not be found. Jul 12 17:25:53.638184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:25:53.638184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:25:53.638184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:25:53.638184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:25:53.638184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:25:53.638184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:25:53.638184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:25:53.638184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:25:53.638184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f4130f0-610a-48e3-9ea7-521fe4488f01 could not be found. Jul 12 17:25:53.638184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:25:53.638184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2e2004b3-8e91-4a3a-af86-5b81c87d28e3 tempest-VolumesGetTestJSON-2010531241 tempest-VolumesGetTestJSON-2010531241-project] Returning 404 to user: Volume 4f4130f0-610a-48e3-9ea7-521fe4488f01 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:25:53.638184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2e2004b3-8e91-4a3a-af86-5b81c87d28e3 tempest-VolumesGetTestJSON-2010531241 tempest-VolumesGetTestJSON-2010531241-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/4f4130f0-610a-48e3-9ea7-521fe4488f01" status: 404 len: 109 microversion: 2.1 time: 0.316645 Jul 12 17:25:53.638184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 7/11] 10.222.0.62 () {58 vars in 1244 bytes} [Tue Jul 12 17:25:53 2022] GET /compute/v2.1/os-volumes/4f4130f0-610a-48e3-9ea7-521fe4488f01 => generated 109 bytes in 318 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:25:53.768237 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a5c08d30-334c-481f-8c6b-db0fc6d7efdd tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.814637 Jul 12 17:25:53.769738 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 5/12] 10.222.0.62 () {60 vars in 1161 bytes} [Tue Jul 12 17:25:52 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:25:53.771866 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a8b913e7-34e2-4923-9037-4aa69794e5a6 tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] Calling method '.version_select at 0x7f872b7bcf70>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:25:53.782495 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e982f6db-9557-492d-9cb6-f6e13c399078 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Calling method '.version_select at 0x7f872b7a6d30>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:25:53.902130 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e982f6db-9557-492d-9cb6-f6e13c399078 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba" status: 200 len: 287 microversion: 2.1 time: 0.125375 Jul 12 17:25:53.903238 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 6/13] 10.222.0.62 () {58 vars in 1250 bytes} [Tue Jul 12 17:25:53 2022] GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba => generated 287 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:25:53.910072 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a8b913e7-34e2-4923-9037-4aa69794e5a6 tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/5085a457-39f4-4315-84e2-58872c40fa05" status: 200 len: 351 microversion: 2.1 time: 0.148337 Jul 12 17:25:53.911645 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 8/14] 10.222.0.62 () {58 vars in 1244 bytes} [Tue Jul 12 17:25:53 2022] GET /compute/v2.1/os-volumes/5085a457-39f4-4315-84e2-58872c40fa05 => generated 351 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:25:53.915355 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-65618d7a-2ae2-4c9e-b09f-f05a73aa9a4d tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Calling method '.version_select at 0x7f872b7a6670>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:25:54.036053 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-65618d7a-2ae2-4c9e-b09f-f05a73aa9a4d tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.125600 Jul 12 17:25:54.036883 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 7/15] 10.222.0.62 () {58 vars in 1139 bytes} [Tue Jul 12 17:25:53 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:25:54.048691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-16feac3e-9dc1-438f-abfa-06ceca30a771 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Calling method '.version_select at 0x7f872b727670>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:25:54.178302 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-16feac3e-9dc1-438f-abfa-06ceca30a771 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba" status: 200 len: 287 microversion: 2.1 time: 0.134180 Jul 12 17:25:54.179549 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 9/16] 10.222.0.62 () {58 vars in 1250 bytes} [Tue Jul 12 17:25:54 2022] GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba => generated 287 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:25:55.192497 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-32711cb2-bba8-44b8-8608-1c8e5a6325dd tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Calling method '.version_select at 0x7f872b7be160>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:25:55.250881 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-32711cb2-bba8-44b8-8608-1c8e5a6325dd tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba" status: 200 len: 287 microversion: 2.1 time: 0.062660 Jul 12 17:25:55.252551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 8/17] 10.222.0.62 () {58 vars in 1250 bytes} [Tue Jul 12 17:25:55 2022] GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:25:56.265479 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-60206959-da07-449d-b372-fd7ebca03ed9 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Calling method '.version_select at 0x7f872b727dc0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:25:56.334196 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-60206959-da07-449d-b372-fd7ebca03ed9 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba" status: 200 len: 287 microversion: 2.1 time: 0.073522 Jul 12 17:25:56.344288 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 10/18] 10.222.0.62 () {58 vars in 1250 bytes} [Tue Jul 12 17:25:56 2022] GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:25:57.362405 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d9e8b8ea-5eb9-4354-97a5-fdff53d0f510 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Calling method '.version_select at 0x7f872b7a6700>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:25:57.460557 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d9e8b8ea-5eb9-4354-97a5-fdff53d0f510 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba" status: 200 len: 287 microversion: 2.1 time: 0.108460 Jul 12 17:25:57.461433 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 9/19] 10.222.0.62 () {58 vars in 1250 bytes} [Tue Jul 12 17:25:57 2022] GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba => generated 287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:25:58.471431 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1dfff9ab-b193-4b66-82bf-1f3dffdd4d09 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Calling method '.version_select at 0x7f872b727700>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:25:58.529460 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1dfff9ab-b193-4b66-82bf-1f3dffdd4d09 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba" status: 200 len: 287 microversion: 2.1 time: 0.061865 Jul 12 17:25:58.530254 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 11/20] 10.222.0.62 () {58 vars in 1250 bytes} [Tue Jul 12 17:25:58 2022] GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:25:59.550809 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a9075619-7c6b-4273-ae96-6507946bc3e1 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Calling method '.version_select at 0x7f872b7a6d30>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:25:59.614887 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a9075619-7c6b-4273-ae96-6507946bc3e1 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba" status: 200 len: 287 microversion: 2.1 time: 0.067876 Jul 12 17:25:59.615926 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 10/21] 10.222.0.62 () {58 vars in 1250 bytes} [Tue Jul 12 17:25:59 2022] GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:26:00.632387 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6a6b194d-c8a3-4988-b89e-9c43a41b75b3 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Calling method '.version_select at 0x7f872b90d280>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:00.739356 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6a6b194d-c8a3-4988-b89e-9c43a41b75b3 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba" status: 200 len: 287 microversion: 2.1 time: 0.115957 Jul 12 17:26:00.746122 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 12/22] 10.222.0.62 () {58 vars in 1250 bytes} [Tue Jul 12 17:26:00 2022] GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba => generated 287 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:26:01.759636 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-273f2c23-91ed-477f-a55c-37c8c2fa4291 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Calling method '.version_select at 0x7f872b7be1f0>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:01.839265 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-273f2c23-91ed-477f-a55c-37c8c2fa4291 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba" status: 200 len: 288 microversion: 2.1 time: 0.091764 Jul 12 17:26:01.845797 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 11/23] 10.222.0.62 () {58 vars in 1250 bytes} [Tue Jul 12 17:26:01 2022] GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba => generated 288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:26:01.856052 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-29f1111e-e939-4ce3-90a4-f9d9c2cbc08b tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Calling method '.version_select at 0x7f872b7bca60>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:02.014197 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-29f1111e-e939-4ce3-90a4-f9d9c2cbc08b tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "DELETE /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba" status: 202 len: 0 microversion: 2.1 time: 0.162275 Jul 12 17:26:02.015263 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 13/24] 10.222.0.62 () {58 vars in 1253 bytes} [Tue Jul 12 17:26:01 2022] DELETE /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:26:02.025795 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-df57391e-c865-47d0-82f8-9e017d8ce6c6 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Calling method '.version_select at 0x7f872b7be3a0>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:02.096351 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-df57391e-c865-47d0-82f8-9e017d8ce6c6 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba" status: 200 len: 287 microversion: 2.1 time: 0.075052 Jul 12 17:26:02.096916 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 12/25] 10.222.0.62 () {58 vars in 1250 bytes} [Tue Jul 12 17:26:02 2022] GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:26:02.513526 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-02bdaf9f-8af1-43d9-93ae-19965e9443cd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-50415091", "imageRef": "b19e7830-75c9-4706-bd34-4954ba6b4cc1", "flavorRef": "452", "networks": [{"uuid": "a1c4c8d6-44ae-4705-be56-d1adafe05772"}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:26:02.740023 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-02bdaf9f-8af1-43d9-93ae-19965e9443cd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] validate_networks() for [('a1c4c8d6-44ae-4705-be56-d1adafe05772', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:26:03.112624 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f691f171-42b8-48ce-ae45-22055c5eabb2 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Calling method '.version_select at 0x7f872b7beb80>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:03.175506 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f691f171-42b8-48ce-ae45-22055c5eabb2 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba" status: 200 len: 287 microversion: 2.1 time: 0.070871 Jul 12 17:26:03.176082 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 13/26] 10.222.0.62 () {58 vars in 1250 bytes} [Tue Jul 12 17:26:03 2022] GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:26:04.483438 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4e9f8390-3cc3-45e4-a0d5-e5b592969523 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-680026403", "imageRef": "b19e7830-75c9-4706-bd34-4954ba6b4cc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:26:04.712652 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.network.neutron [None req-4e9f8390-3cc3-45e4-a0d5-e5b592969523 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] validate_networks() for [('5a270b63-04b7-42b7-ba5e-a9545ef80e4a', None, None, None, None, None)] {{(pid=117939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:26:05.311458 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-02bdaf9f-8af1-43d9-93ae-19965e9443cd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:26:05.312526 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-02bdaf9f-8af1-43d9-93ae-19965e9443cd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:26:05.313042 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-02bdaf9f-8af1-43d9-93ae-19965e9443cd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:26:05.313418 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-02bdaf9f-8af1-43d9-93ae-19965e9443cd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:26:05.313867 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-02bdaf9f-8af1-43d9-93ae-19965e9443cd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:26:05.351263 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02bdaf9f-8af1-43d9-93ae-19965e9443cd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:05.352715 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02bdaf9f-8af1-43d9-93ae-19965e9443cd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:05.354287 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02bdaf9f-8af1-43d9-93ae-19965e9443cd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:05.355549 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02bdaf9f-8af1-43d9-93ae-19965e9443cd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:05.414451 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-02bdaf9f-8af1-43d9-93ae-19965e9443cd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Getting quotas for project fac7ab2675b74a88bc33a21ffbc31586. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:26:05.424788 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-02bdaf9f-8af1-43d9-93ae-19965e9443cd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Getting quotas for user 0ad21d1c348f49c5b74c1e27efdf58b1 and project fac7ab2675b74a88bc33a21ffbc31586. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:26:05.448386 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-02bdaf9f-8af1-43d9-93ae-19965e9443cd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:26:05.457635 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-02bdaf9f-8af1-43d9-93ae-19965e9443cd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19e7830-75c9-4706-bd34-4954ba6b4cc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:26:05.621591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-02bdaf9f-8af1-43d9-93ae-19965e9443cd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.427660 Jul 12 17:26:05.622258 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 14/27] 10.222.0.62 () {60 vars in 1146 bytes} [Tue Jul 12 17:26:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:26:05.638928 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8c7eeb90-4cea-4bf0-87d0-9704e5d17eee tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Calling method '.version_select at 0x7f872ae22310>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:05.684773 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8c7eeb90-4cea-4bf0-87d0-9704e5d17eee tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba" status: 200 len: 287 microversion: 2.1 time: 0.056233 Jul 12 17:26:05.685425 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 15/28] 10.222.0.62 () {58 vars in 1250 bytes} [Tue Jul 12 17:26:05 2022] GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:26:06.175187 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-543340e3-56be-456b-adf6-d34d758541fa tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Action: 'create', calling method: .version_select at 0x7f872ae229d0>, body: {"keypair": {"name": "tempest-keypair-1426069321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGhbgJ/QDaLSGcYiT+aieywasNnm4CFYB01xi4KYOtKphwrvwgdrpzDLQVoHPE97J31uqHfWBLH+BrXI8uPcRcKI5LpDK2jr6goRLfKt6TV6WnYcdUWbTbBZ7XOh+GwuA=="}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:26:06.232716 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-543340e3-56be-456b-adf6-d34d758541fa tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Getting quotas for project 4a4e837b171b4b4a9c2ad230cda53452. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:26:06.244494 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-543340e3-56be-456b-adf6-d34d758541fa tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Getting quotas for user 38a74ebdd59a491386aedcdbd312b363 and project 4a4e837b171b4b4a9c2ad230cda53452. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:26:06.353165 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-543340e3-56be-456b-adf6-d34d758541fa tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.661758 Jul 12 17:26:06.353834 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 16/29] 10.222.0.62 () {60 vars in 1158 bytes} [Tue Jul 12 17:26:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:26:06.397047 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3520c335-c1af-4e02-a4b9-3d02a9e8c07c tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:06.404096 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3520c335-c1af-4e02-a4b9-3d02a9e8c07c tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:06.835908 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3520c335-c1af-4e02-a4b9-3d02a9e8c07c tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:06.867262 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3520c335-c1af-4e02-a4b9-3d02a9e8c07c tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1213 microversion: 2.1 time: 0.511747 Jul 12 17:26:06.868803 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 17/30] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:06 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1213 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:06.882760 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e5199966-28f2-479b-a5ff-e1979ca0f4e7 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Calling method '.version_select at 0x7f872ae2cd30>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:06.975019 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-e5199966-28f2-479b-a5ff-e1979ca0f4e7 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] HTTP exception thrown: Snapshot 1df29d94-f25b-437e-8b97-11da658a07ba could not be found. Jul 12 17:26:06.985429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e5199966-28f2-479b-a5ff-e1979ca0f4e7 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Request method failure captured: Jul 12 17:26:06.985429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba HTTP/1.1 Jul 12 17:26:06.985429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:26:06.985429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:26:06.985429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:26:06.985429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:26:06.985429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:26:06.985429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:26:06.985429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:26:06.985429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:26:06.985429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza6dvlmHtMeXvz2969vQMJHR9phWZT-OSrd0FKDHeQxRZCsj9J7eN7XIaBHT1_iiVF6JYKehilpB6Ku7s6g7h-b5WuNrgba_1YdQfr6n62ZqDT5hr_RvQcYW2Nxnm5WAfhvokWllJ9DOLWJwtDQ_V2BKNw_gLegXsBuei6c3FS35xA4 Jul 12 17:26:06.985429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:26:06.985429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:26:06.985429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:26:06.985429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:26:06.985429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:26:06.985429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:26:06.985429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: d90edd6f5e304b669c5ba857293c8e28 Jul 12 17:26:06.985429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1786161577 Jul 12 17:26:06.985429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:26:06.985429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:26:06.986617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d90edd6f5e304b669c5ba857293c8e28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d90edd6f5e304b669c5ba857293c8e28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d90edd6f5e304b669c5ba857293c8e28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d90edd6f5e304b669c5ba857293c8e28", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:26:06.986617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1786161577 Jul 12 17:26:06.986617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: d90edd6f5e304b669c5ba857293c8e28 Jul 12 17:26:06.986617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1786161577 Jul 12 17:26:06.986617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesSnapshotsTestJSON-1786161577-project Jul 12 17:26:06.986617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:26:06.986617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:26:06.986617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: 563e1a872be942e8b2209f2de5c5764e Jul 12 17:26:06.986617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1786161577-project Jul 12 17:26:06.986617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: Jul 12 17:26:06.986617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Snapshot 1df29d94-f25b-437e-8b97-11da658a07ba could not be found. Jul 12 17:26:06.986617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': '1df29d94-f25b-437e-8b97-11da658a07ba'} Jul 12 17:26:06.986617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:26:06.987357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:06.987357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 17:26:06.987357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 17:26:06.987357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 17:26:06.987357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 17:26:06.987357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 17:26:06.987357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 17:26:06.987357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 17:26:06.987357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 17:26:06.987357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 17:26:06.987357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 17:26:06.987357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:26:06.987357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:26:06.987357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:26:06.987357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:26:06.987357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1df29d94-f25b-437e-8b97-11da658a07ba could not be found. (HTTP 404) (Request-ID: req-59a31111-1001-4940-b411-d09770db1f68) Jul 12 17:26:06.987357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:06.987357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:06.988317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:06.988317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:06.988317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 12 17:26:06.988317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 12 17:26:06.988317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 17:26:06.988317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 17:26:06.988317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 12 17:26:06.988317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 12 17:26:06.988317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 17:26:06.988317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 17:26:06.988317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 17:26:06.988317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 17:26:06.988317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 17:26:06.988317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 17:26:06.988317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 17:26:06.988317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 17:26:06.988317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 17:26:06.988317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 17:26:06.988317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 17:26:06.989273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 17:26:06.989273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:26:06.989273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:26:06.989273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:26:06.989273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:26:06.989273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1df29d94-f25b-437e-8b97-11da658a07ba could not be found. Jul 12 17:26:06.989273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:06.989273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:06.989273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:06.989273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:06.989273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:26:06.989273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:26:06.989273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:26:06.989273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:26:06.989273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:26:06.989273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:26:06.989273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:26:06.989273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:26:06.989273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 12 17:26:06.989273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:26:06.990591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1df29d94-f25b-437e-8b97-11da658a07ba could not be found. Jul 12 17:26:06.990591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:06.990591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:06.990591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:06.990591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:06.990591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:26:06.990591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:26:06.990591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:26:06.990591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:26:06.990591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1df29d94-f25b-437e-8b97-11da658a07ba could not be found. Jul 12 17:26:06.990591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:06.996540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e5199966-28f2-479b-a5ff-e1979ca0f4e7 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Returning 404 to user: Snapshot 1df29d94-f25b-437e-8b97-11da658a07ba could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:26:06.998708 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e5199966-28f2-479b-a5ff-e1979ca0f4e7 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba" status: 404 len: 111 microversion: 2.1 time: 0.128761 Jul 12 17:26:06.999917 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 18/31] 10.222.0.62 () {58 vars in 1250 bytes} [Tue Jul 12 17:26:06 2022] GET /compute/v2.1/os-snapshots/1df29d94-f25b-437e-8b97-11da658a07ba => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:26:07.009781 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e427a34d-8f14-4791-b9a7-5efb03b23e87 tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] Calling method '.version_select at 0x7f8729e033a0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:07.145937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e427a34d-8f14-4791-b9a7-5efb03b23e87 tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/73b7a766-7e48-4252-a71a-25e1785fddc9" status: 200 len: 351 microversion: 2.1 time: 0.144580 Jul 12 17:26:07.146537 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 19/32] 10.222.0.62 () {58 vars in 1244 bytes} [Tue Jul 12 17:26:07 2022] GET /compute/v2.1/os-volumes/73b7a766-7e48-4252-a71a-25e1785fddc9 => generated 351 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:26:07.162399 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8ec1a115-ef97-47f3-8c23-b8fd16c98f7c tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Calling method '.version_select at 0x7f8729deaa60>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:07.596062 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-4e9f8390-3cc3-45e4-a0d5-e5b592969523 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Flavor limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:26:07.596062 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-4e9f8390-3cc3-45e4-a0d5-e5b592969523 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Image limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:26:07.596484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-4e9f8390-3cc3-45e4-a0d5-e5b592969523 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Flavor pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:26:07.598253 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-4e9f8390-3cc3-45e4-a0d5-e5b592969523 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Image pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:26:07.598710 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-4e9f8390-3cc3-45e4-a0d5-e5b592969523 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:26:07.651078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8ec1a115-ef97-47f3-8c23-b8fd16c98f7c tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/9bca82fb-f67e-4ed3-bbe2-c110382c2811" status: 202 len: 0 microversion: 2.1 time: 0.495077 Jul 12 17:26:07.652553 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 20/33] 10.222.0.62 () {58 vars in 1247 bytes} [Tue Jul 12 17:26:07 2022] DELETE /compute/v2.1/os-volumes/9bca82fb-f67e-4ed3-bbe2-c110382c2811 => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:26:07.656864 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ad1aead1-1f2e-473a-b670-0d0aac497871 tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] Calling method '.version_select at 0x7f872ae2c280>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:07.689771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4e9f8390-3cc3-45e4-a0d5-e5b592969523 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:07.699164 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4e9f8390-3cc3-45e4-a0d5-e5b592969523 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:07.704642 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4e9f8390-3cc3-45e4-a0d5-e5b592969523 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:07.713716 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4e9f8390-3cc3-45e4-a0d5-e5b592969523 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:07.923027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-4e9f8390-3cc3-45e4-a0d5-e5b592969523 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Getting quotas for project 13884af024db42bcb013e475df0a53f0. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:26:07.974077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-4e9f8390-3cc3-45e4-a0d5-e5b592969523 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Getting quotas for user 35e0364ccc1d4992932e8483e3f1f9d6 and project 13884af024db42bcb013e475df0a53f0. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:26:07.991958 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4e9f8390-3cc3-45e4-a0d5-e5b592969523 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Going to run 1 instances... {{(pid=117939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:26:07.996054 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4e9f8390-3cc3-45e4-a0d5-e5b592969523 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19e7830-75c9-4706-bd34-4954ba6b4cc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:26:08.013385 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ad1aead1-1f2e-473a-b670-0d0aac497871 tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.360653 Jul 12 17:26:08.014220 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 21/34] 10.222.0.62 () {58 vars in 1133 bytes} [Tue Jul 12 17:26:07 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:08.029279 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c033aedc-0611-4ad1-a2fd-7e2cc82467e4 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Calling method '.version_select at 0x7f8729e03940>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:08.200024 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-c033aedc-0611-4ad1-a2fd-7e2cc82467e4 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] HTTP exception thrown: Volume 9bca82fb-f67e-4ed3-bbe2-c110382c2811 could not be found. Jul 12 17:26:08.206036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c033aedc-0611-4ad1-a2fd-7e2cc82467e4 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Request method failure captured: Jul 12 17:26:08.206036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/os-volumes/9bca82fb-f67e-4ed3-bbe2-c110382c2811 HTTP/1.1 Jul 12 17:26:08.206036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:26:08.206036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:26:08.206036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:26:08.206036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:26:08.206036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:26:08.206036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:26:08.206036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:26:08.206036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:26:08.206036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza6dvlmHtMeXvz2969vQMJHR9phWZT-OSrd0FKDHeQxRZCsj9J7eN7XIaBHT1_iiVF6JYKehilpB6Ku7s6g7h-b5WuNrgba_1YdQfr6n62ZqDT5hr_RvQcYW2Nxnm5WAfhvokWllJ9DOLWJwtDQ_V2BKNw_gLegXsBuei6c3FS35xA4 Jul 12 17:26:08.206036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:26:08.206036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:26:08.206036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:26:08.206036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:26:08.206036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:26:08.206036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:26:08.206036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: d90edd6f5e304b669c5ba857293c8e28 Jul 12 17:26:08.206036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1786161577 Jul 12 17:26:08.206036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:26:08.206036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:26:08.208059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d90edd6f5e304b669c5ba857293c8e28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d90edd6f5e304b669c5ba857293c8e28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d90edd6f5e304b669c5ba857293c8e28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d90edd6f5e304b669c5ba857293c8e28", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:26:08.208059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1786161577 Jul 12 17:26:08.208059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: d90edd6f5e304b669c5ba857293c8e28 Jul 12 17:26:08.208059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1786161577 Jul 12 17:26:08.208059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesSnapshotsTestJSON-1786161577-project Jul 12 17:26:08.208059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:26:08.208059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:26:08.208059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: 563e1a872be942e8b2209f2de5c5764e Jul 12 17:26:08.208059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1786161577-project Jul 12 17:26:08.208059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: Jul 12 17:26:08.208059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Volume 9bca82fb-f67e-4ed3-bbe2-c110382c2811 could not be found. Jul 12 17:26:08.208059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': '9bca82fb-f67e-4ed3-bbe2-c110382c2811'} Jul 12 17:26:08.208059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:26:08.210513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:08.210513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:26:08.210513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:26:08.210513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 17:26:08.210513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 17:26:08.210513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 17:26:08.210513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 17:26:08.210513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 17:26:08.210513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 17:26:08.210513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 17:26:08.210513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 17:26:08.210513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:26:08.210513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:26:08.210513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:26:08.210513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:26:08.210513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9bca82fb-f67e-4ed3-bbe2-c110382c2811 could not be found. (HTTP 404) (Request-ID: req-323aa5af-be90-4ad6-a426-56b11985ecd4) Jul 12 17:26:08.210513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:08.210513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:08.210513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:08.212093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:08.212093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 17:26:08.212093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 17:26:08.212093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 17:26:08.212093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 17:26:08.212093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 17:26:08.212093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 17:26:08.212093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 17:26:08.212093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 17:26:08.212093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:26:08.212093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:26:08.212093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 17:26:08.212093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 17:26:08.212093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 17:26:08.212093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 17:26:08.212093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 17:26:08.212093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 17:26:08.212093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 17:26:08.212093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 17:26:08.213267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:26:08.213267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:26:08.213267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:26:08.213267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:26:08.213267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9bca82fb-f67e-4ed3-bbe2-c110382c2811 could not be found. Jul 12 17:26:08.213267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:08.213267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:08.213267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:08.213267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:08.213267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:26:08.213267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:26:08.213267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:26:08.213267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:26:08.213267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:26:08.213267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:26:08.213267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:26:08.213267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:26:08.213267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 17:26:08.213267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:26:08.215646 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9bca82fb-f67e-4ed3-bbe2-c110382c2811 could not be found. Jul 12 17:26:08.215646 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:08.215646 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:08.215646 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:08.215646 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:08.215646 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:26:08.215646 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:26:08.215646 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:26:08.215646 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:26:08.215646 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9bca82fb-f67e-4ed3-bbe2-c110382c2811 could not be found. Jul 12 17:26:08.215646 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:08.215646 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c033aedc-0611-4ad1-a2fd-7e2cc82467e4 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Returning 404 to user: Volume 9bca82fb-f67e-4ed3-bbe2-c110382c2811 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:26:08.215646 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c033aedc-0611-4ad1-a2fd-7e2cc82467e4 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/9bca82fb-f67e-4ed3-bbe2-c110382c2811" status: 404 len: 109 microversion: 2.1 time: 0.184411 Jul 12 17:26:08.215646 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 22/35] 10.222.0.62 () {58 vars in 1244 bytes} [Tue Jul 12 17:26:08 2022] GET /compute/v2.1/os-volumes/9bca82fb-f67e-4ed3-bbe2-c110382c2811 => generated 109 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:26:08.229043 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5c8cac9a-69dc-4f76-9a5c-396cfc005ed5 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:08.229852 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5c8cac9a-69dc-4f76-9a5c-396cfc005ed5 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:08.327145 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4e9f8390-3cc3-45e4-a0d5-e5b592969523 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.233827 Jul 12 17:26:08.330610 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 14/36] 10.222.0.62 () {60 vars in 1146 bytes} [Tue Jul 12 17:26:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 4238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:26:08.349541 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-41dd5cfb-50c5-4282-9907-7895135551b4 tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] Calling method '.version_select at 0x7f872b6b7d30>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:08.395780 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5c8cac9a-69dc-4f76-9a5c-396cfc005ed5 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:08.406146 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5c8cac9a-69dc-4f76-9a5c-396cfc005ed5 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1213 microversion: 2.1 time: 0.196163 Jul 12 17:26:08.412856 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 23/37] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:08 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1213 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:08.427760 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cfa4a61f-db6f-49d2-a667-c2f73c1c0543 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Calling method '.version_select at 0x7f8729e03430>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:08.508081 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-cfa4a61f-db6f-49d2-a667-c2f73c1c0543 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] HTTP exception thrown: Volume 9bca82fb-f67e-4ed3-bbe2-c110382c2811 could not be found. Jul 12 17:26:08.510291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cfa4a61f-db6f-49d2-a667-c2f73c1c0543 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Request method failure captured: Jul 12 17:26:08.510291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/os-volumes/9bca82fb-f67e-4ed3-bbe2-c110382c2811 HTTP/1.1 Jul 12 17:26:08.510291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:26:08.510291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:26:08.510291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:26:08.510291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:26:08.510291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:26:08.510291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:26:08.510291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:26:08.510291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:26:08.510291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza6dvlmHtMeXvz2969vQMJHR9phWZT-OSrd0FKDHeQxRZCsj9J7eN7XIaBHT1_iiVF6JYKehilpB6Ku7s6g7h-b5WuNrgba_1YdQfr6n62ZqDT5hr_RvQcYW2Nxnm5WAfhvokWllJ9DOLWJwtDQ_V2BKNw_gLegXsBuei6c3FS35xA4 Jul 12 17:26:08.510291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:26:08.510291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:26:08.510291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:26:08.510291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:26:08.510291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:26:08.510291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:26:08.510291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: d90edd6f5e304b669c5ba857293c8e28 Jul 12 17:26:08.510291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1786161577 Jul 12 17:26:08.510291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:26:08.510291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:26:08.511376 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d90edd6f5e304b669c5ba857293c8e28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d90edd6f5e304b669c5ba857293c8e28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d90edd6f5e304b669c5ba857293c8e28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d90edd6f5e304b669c5ba857293c8e28", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:26:08.511376 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1786161577 Jul 12 17:26:08.511376 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: d90edd6f5e304b669c5ba857293c8e28 Jul 12 17:26:08.511376 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1786161577 Jul 12 17:26:08.511376 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesSnapshotsTestJSON-1786161577-project Jul 12 17:26:08.511376 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:26:08.511376 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:26:08.511376 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: 563e1a872be942e8b2209f2de5c5764e Jul 12 17:26:08.511376 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1786161577-project Jul 12 17:26:08.511376 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: Jul 12 17:26:08.511376 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Volume 9bca82fb-f67e-4ed3-bbe2-c110382c2811 could not be found. Jul 12 17:26:08.511376 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': '9bca82fb-f67e-4ed3-bbe2-c110382c2811'} Jul 12 17:26:08.511376 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:26:08.512038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:08.512038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:26:08.512038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:26:08.512038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 17:26:08.512038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 17:26:08.512038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 17:26:08.512038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 17:26:08.512038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 17:26:08.512038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 17:26:08.512038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 17:26:08.512038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 17:26:08.512038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:26:08.512038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:26:08.512038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:26:08.512038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:26:08.512038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9bca82fb-f67e-4ed3-bbe2-c110382c2811 could not be found. (HTTP 404) (Request-ID: req-f5deae07-c28b-41dd-ae1b-14cef14b2944) Jul 12 17:26:08.512038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:08.512038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:08.512038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:08.512979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:08.512979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 17:26:08.512979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 17:26:08.512979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 17:26:08.512979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 17:26:08.512979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 17:26:08.512979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 17:26:08.512979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 17:26:08.512979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 17:26:08.512979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:26:08.512979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:26:08.512979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 17:26:08.512979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 17:26:08.512979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 17:26:08.512979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 17:26:08.512979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 17:26:08.512979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 17:26:08.512979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 17:26:08.512979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 17:26:08.513992 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:26:08.513992 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:26:08.513992 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:26:08.513992 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:26:08.513992 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9bca82fb-f67e-4ed3-bbe2-c110382c2811 could not be found. Jul 12 17:26:08.513992 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:08.513992 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:08.513992 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:08.513992 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:08.513992 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:26:08.513992 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:26:08.513992 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:26:08.513992 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:26:08.513992 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:26:08.513992 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:26:08.513992 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:26:08.513992 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:26:08.513992 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 17:26:08.513992 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:26:08.514924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9bca82fb-f67e-4ed3-bbe2-c110382c2811 could not be found. Jul 12 17:26:08.514924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:08.514924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:08.514924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:08.514924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:08.514924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:26:08.514924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:26:08.514924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:26:08.514924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:26:08.514924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9bca82fb-f67e-4ed3-bbe2-c110382c2811 could not be found. Jul 12 17:26:08.514924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:08.514924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cfa4a61f-db6f-49d2-a667-c2f73c1c0543 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Returning 404 to user: Volume 9bca82fb-f67e-4ed3-bbe2-c110382c2811 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:26:08.514924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cfa4a61f-db6f-49d2-a667-c2f73c1c0543 tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/9bca82fb-f67e-4ed3-bbe2-c110382c2811" status: 404 len: 109 microversion: 2.1 time: 0.092110 Jul 12 17:26:08.514924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 24/38] 10.222.0.62 () {58 vars in 1247 bytes} [Tue Jul 12 17:26:08 2022] DELETE /compute/v2.1/os-volumes/9bca82fb-f67e-4ed3-bbe2-c110382c2811 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:26:08.527230 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-70168da9-d1f8-4dfb-b405-7c7dbe1d0de4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:08.527849 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-70168da9-d1f8-4dfb-b405-7c7dbe1d0de4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:08.577786 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-41dd5cfb-50c5-4282-9907-7895135551b4 tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.244102 Jul 12 17:26:08.578655 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 15/39] 10.222.0.62 () {58 vars in 1148 bytes} [Tue Jul 12 17:26:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:26:08.591903 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b34e2be5-0c5e-499a-b824-501b0b8e175d tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Calling method '.version_select at 0x7f872a64ed30>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:08.679234 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-b34e2be5-0c5e-499a-b824-501b0b8e175d tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] HTTP exception thrown: Volume 9bca82fb-f67e-4ed3-bbe2-c110382c2811 could not be found. Jul 12 17:26:08.683454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b34e2be5-0c5e-499a-b824-501b0b8e175d tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Request method failure captured: Jul 12 17:26:08.683454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/os-volumes/9bca82fb-f67e-4ed3-bbe2-c110382c2811 HTTP/1.1 Jul 12 17:26:08.683454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:26:08.683454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:26:08.683454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:26:08.683454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:26:08.683454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:26:08.683454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:26:08.683454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:26:08.683454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:26:08.683454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza6dvlmHtMeXvz2969vQMJHR9phWZT-OSrd0FKDHeQxRZCsj9J7eN7XIaBHT1_iiVF6JYKehilpB6Ku7s6g7h-b5WuNrgba_1YdQfr6n62ZqDT5hr_RvQcYW2Nxnm5WAfhvokWllJ9DOLWJwtDQ_V2BKNw_gLegXsBuei6c3FS35xA4 Jul 12 17:26:08.683454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:26:08.683454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:26:08.683454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:26:08.683454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:26:08.683454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:26:08.683454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:26:08.683454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: d90edd6f5e304b669c5ba857293c8e28 Jul 12 17:26:08.683454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1786161577 Jul 12 17:26:08.683454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:26:08.683454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:26:08.684520 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d90edd6f5e304b669c5ba857293c8e28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d90edd6f5e304b669c5ba857293c8e28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d90edd6f5e304b669c5ba857293c8e28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d90edd6f5e304b669c5ba857293c8e28", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:26:08.684520 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1786161577 Jul 12 17:26:08.684520 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: d90edd6f5e304b669c5ba857293c8e28 Jul 12 17:26:08.684520 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1786161577 Jul 12 17:26:08.684520 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-VolumesSnapshotsTestJSON-1786161577-project Jul 12 17:26:08.684520 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:26:08.684520 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:26:08.684520 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: 563e1a872be942e8b2209f2de5c5764e Jul 12 17:26:08.684520 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1786161577-project Jul 12 17:26:08.684520 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: Jul 12 17:26:08.684520 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Volume 9bca82fb-f67e-4ed3-bbe2-c110382c2811 could not be found. Jul 12 17:26:08.684520 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': '9bca82fb-f67e-4ed3-bbe2-c110382c2811'} Jul 12 17:26:08.684520 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:26:08.685175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:08.685175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:26:08.685175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:26:08.685175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 17:26:08.685175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 17:26:08.685175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 17:26:08.685175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 17:26:08.685175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 17:26:08.685175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 17:26:08.685175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 17:26:08.685175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 17:26:08.685175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:26:08.685175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:26:08.685175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:26:08.685175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:26:08.685175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9bca82fb-f67e-4ed3-bbe2-c110382c2811 could not be found. (HTTP 404) (Request-ID: req-ceba5ce3-d879-435e-ae0f-4e210b759a44) Jul 12 17:26:08.685175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:26:08.685175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:08.685175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:26:08.686687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:08.686687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 17:26:08.686687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 17:26:08.686687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 17:26:08.686687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 17:26:08.686687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 17:26:08.686687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 17:26:08.686687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 17:26:08.686687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 17:26:08.686687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:26:08.686687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:26:08.686687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 17:26:08.686687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 17:26:08.686687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 17:26:08.686687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 17:26:08.686687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 17:26:08.686687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 17:26:08.686687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 17:26:08.686687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 17:26:08.687603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:26:08.687603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:26:08.687603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:26:08.687603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:26:08.687603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9bca82fb-f67e-4ed3-bbe2-c110382c2811 could not be found. Jul 12 17:26:08.687603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:26:08.687603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:08.687603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:26:08.687603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:08.687603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:26:08.687603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:26:08.687603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:26:08.687603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:26:08.687603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:26:08.687603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:26:08.687603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:26:08.687603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:26:08.687603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 17:26:08.687603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:26:08.688508 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9bca82fb-f67e-4ed3-bbe2-c110382c2811 could not be found. Jul 12 17:26:08.688508 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:26:08.688508 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:08.688508 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:26:08.688508 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:08.688508 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:26:08.688508 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:26:08.688508 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:26:08.688508 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:26:08.688508 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9bca82fb-f67e-4ed3-bbe2-c110382c2811 could not be found. Jul 12 17:26:08.688508 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:26:08.688508 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b34e2be5-0c5e-499a-b824-501b0b8e175d tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] Returning 404 to user: Volume 9bca82fb-f67e-4ed3-bbe2-c110382c2811 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:26:08.688508 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b34e2be5-0c5e-499a-b824-501b0b8e175d tempest-VolumesSnapshotsTestJSON-1786161577 tempest-VolumesSnapshotsTestJSON-1786161577-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/9bca82fb-f67e-4ed3-bbe2-c110382c2811" status: 404 len: 109 microversion: 2.1 time: 0.097597 Jul 12 17:26:08.688508 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 16/40] 10.222.0.62 () {58 vars in 1244 bytes} [Tue Jul 12 17:26:08 2022] GET /compute/v2.1/os-volumes/9bca82fb-f67e-4ed3-bbe2-c110382c2811 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:26:08.710527 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ca09598f-f28b-4ddd-930b-134147e51259 tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] Calling method '.version_select at 0x7f872a65a700>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:08.769787 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-70168da9-d1f8-4dfb-b405-7c7dbe1d0de4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:08.778510 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-70168da9-d1f8-4dfb-b405-7c7dbe1d0de4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1221 microversion: 2.1 time: 0.265288 Jul 12 17:26:08.779102 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 25/41] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:08 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1221 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:08.974782 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ca09598f-f28b-4ddd-930b-134147e51259 tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.287724 Jul 12 17:26:08.976017 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 17/42] 10.222.0.62 () {58 vars in 1133 bytes} [Tue Jul 12 17:26:08 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:08.987258 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0cd17399-8601-4d38-8e43-c9d3c2939e43 tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] Calling method '.version_select at 0x7f8729e03280>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:09.225435 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3267c833-dff6-4d6e-af4f-00383041b598 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1232215417", "imageRef": "b19e7830-75c9-4706-bd34-4954ba6b4cc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:26:09.246559 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0cd17399-8601-4d38-8e43-c9d3c2939e43 tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.262947 Jul 12 17:26:09.254592 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 26/43] 10.222.0.62 () {58 vars in 1166 bytes} [Tue Jul 12 17:26:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:26:09.260695 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-085183d2-c529-4dbc-9737-4388863e9453 tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] Calling method '.version_select at 0x7f8729dd6670>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:09.349973 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.network.neutron [None req-3267c833-dff6-4d6e-af4f-00383041b598 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] validate_networks() for [('5a270b63-04b7-42b7-ba5e-a9545ef80e4a', None, None, None, None, None)] {{(pid=117939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:26:09.561580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-085183d2-c529-4dbc-9737-4388863e9453 tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.305512 Jul 12 17:26:09.562440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 27/44] 10.222.0.62 () {58 vars in 1169 bytes} [Tue Jul 12 17:26:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:26:09.583020 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-db16f5e8-cffa-47e3-942c-2d4b3c4b52cb tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:09.583901 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-db16f5e8-cffa-47e3-942c-2d4b3c4b52cb tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:09.619471 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db16f5e8-cffa-47e3-942c-2d4b3c4b52cb tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:09.620937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db16f5e8-cffa-47e3-942c-2d4b3c4b52cb tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:09.625912 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db16f5e8-cffa-47e3-942c-2d4b3c4b52cb tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:09.627548 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db16f5e8-cffa-47e3-942c-2d4b3c4b52cb tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:10.613349 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-db16f5e8-cffa-47e3-942c-2d4b3c4b52cb tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:10.651846 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-db16f5e8-cffa-47e3-942c-2d4b3c4b52cb tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1273 microversion: 2.1 time: 1.069769 Jul 12 17:26:10.655572 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 28/45] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:09 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1273 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:10.675229 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-716e982d-3c04-490d-94a5-8402949c7f49 tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] Calling method '.version_select at 0x7f8729d7bca0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:10.984222 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-716e982d-3c04-490d-94a5-8402949c7f49 tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.327519 Jul 12 17:26:10.991221 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 29/46] 10.222.0.62 () {58 vars in 1154 bytes} [Tue Jul 12 17:26:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:10.997836 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b7115c17-1f36-45f5-b344-335a9b16daac tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] Calling method '.version_select at 0x7f8729d89160>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:11.231045 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-3267c833-dff6-4d6e-af4f-00383041b598 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Flavor limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:26:11.231486 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-3267c833-dff6-4d6e-af4f-00383041b598 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Image limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:26:11.232190 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-3267c833-dff6-4d6e-af4f-00383041b598 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Flavor pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:26:11.232692 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-3267c833-dff6-4d6e-af4f-00383041b598 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Image pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:26:11.233249 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-3267c833-dff6-4d6e-af4f-00383041b598 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:26:11.259506 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3267c833-dff6-4d6e-af4f-00383041b598 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:11.268439 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3267c833-dff6-4d6e-af4f-00383041b598 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:11.269508 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3267c833-dff6-4d6e-af4f-00383041b598 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:11.276936 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3267c833-dff6-4d6e-af4f-00383041b598 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:11.333370 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b7115c17-1f36-45f5-b344-335a9b16daac tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.340691 Jul 12 17:26:11.340265 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 30/47] 10.222.0.62 () {58 vars in 1187 bytes} [Tue Jul 12 17:26:10 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:26:11.347996 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fff3a75d-f050-4885-be15-95c49cd1c5d4 tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] Calling method '.version_select at 0x7f8729d2c9d0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:11.349852 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-3267c833-dff6-4d6e-af4f-00383041b598 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Getting quotas for project 13884af024db42bcb013e475df0a53f0. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:26:11.359183 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-3267c833-dff6-4d6e-af4f-00383041b598 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Getting quotas for user 35e0364ccc1d4992932e8483e3f1f9d6 and project 13884af024db42bcb013e475df0a53f0. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:26:11.445148 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3267c833-dff6-4d6e-af4f-00383041b598 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Going to run 1 instances... {{(pid=117939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:26:11.448980 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3267c833-dff6-4d6e-af4f-00383041b598 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19e7830-75c9-4706-bd34-4954ba6b4cc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:26:11.517443 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3267c833-dff6-4d6e-af4f-00383041b598 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.296188 Jul 12 17:26:11.518771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 18/48] 10.222.0.62 () {60 vars in 1146 bytes} [Tue Jul 12 17:26:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 2298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:26:11.538750 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6d04c557-5ce7-4e08-ac43-a07302e72fde tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:11.543731 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6d04c557-5ce7-4e08-ac43-a07302e72fde tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:11.617808 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fff3a75d-f050-4885-be15-95c49cd1c5d4 tempest-VolumesTestJSON-514852527 tempest-VolumesTestJSON-514852527-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.272964 Jul 12 17:26:11.626070 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 31/49] 10.222.0.62 () {58 vars in 1154 bytes} [Tue Jul 12 17:26:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:26:11.685446 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-257b6b4a-9a66-46d9-a9f8-1824616597a7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:11.686920 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-257b6b4a-9a66-46d9-a9f8-1824616597a7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:11.724081 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-257b6b4a-9a66-46d9-a9f8-1824616597a7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:11.724617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-257b6b4a-9a66-46d9-a9f8-1824616597a7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:11.726959 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6d04c557-5ce7-4e08-ac43-a07302e72fde tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:11.732816 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-257b6b4a-9a66-46d9-a9f8-1824616597a7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:11.733131 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-257b6b4a-9a66-46d9-a9f8-1824616597a7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:11.755866 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6d04c557-5ce7-4e08-ac43-a07302e72fde tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1222 microversion: 2.1 time: 0.224524 Jul 12 17:26:11.758448 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 19/50] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:11 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1222 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:11.909884 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-257b6b4a-9a66-46d9-a9f8-1824616597a7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:11.925643 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-257b6b4a-9a66-46d9-a9f8-1824616597a7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1271 microversion: 2.1 time: 0.258929 Jul 12 17:26:11.928893 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 32/51] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:11 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1271 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:12.782091 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-406ee121-9d2e-4227-bb44-1281193baaf6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:12.783245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-406ee121-9d2e-4227-bb44-1281193baaf6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:12.815114 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-406ee121-9d2e-4227-bb44-1281193baaf6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:12.817411 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-406ee121-9d2e-4227-bb44-1281193baaf6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:12.822670 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-406ee121-9d2e-4227-bb44-1281193baaf6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:12.823204 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-406ee121-9d2e-4227-bb44-1281193baaf6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:12.942576 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f8ed9d2e-acb5-4ef1-b834-0e234018589e tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:12.944302 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f8ed9d2e-acb5-4ef1-b834-0e234018589e tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:12.957639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f8ed9d2e-acb5-4ef1-b834-0e234018589e tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:12.958356 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f8ed9d2e-acb5-4ef1-b834-0e234018589e tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:12.959331 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f8ed9d2e-acb5-4ef1-b834-0e234018589e tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:12.960522 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f8ed9d2e-acb5-4ef1-b834-0e234018589e tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:13.091134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f8ed9d2e-acb5-4ef1-b834-0e234018589e tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:13.098658 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f8ed9d2e-acb5-4ef1-b834-0e234018589e tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1271 microversion: 2.1 time: 0.159871 Jul 12 17:26:13.108674 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 33/52] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:12 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:13.134949 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-406ee121-9d2e-4227-bb44-1281193baaf6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:13.156590 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-406ee121-9d2e-4227-bb44-1281193baaf6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1274 microversion: 2.1 time: 0.379337 Jul 12 17:26:13.158395 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 20/53] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:12 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1274 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:14.117909 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-82319eb8-5908-489f-bfbf-24a042b2e4b5 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:14.119295 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-82319eb8-5908-489f-bfbf-24a042b2e4b5 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:14.134554 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-82319eb8-5908-489f-bfbf-24a042b2e4b5 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:14.135011 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-82319eb8-5908-489f-bfbf-24a042b2e4b5 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:14.135799 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-82319eb8-5908-489f-bfbf-24a042b2e4b5 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:14.136239 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-82319eb8-5908-489f-bfbf-24a042b2e4b5 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:14.183474 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7e60016d-49ad-4ec4-a5f5-cb2cb0b9ed98 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:14.188529 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7e60016d-49ad-4ec4-a5f5-cb2cb0b9ed98 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:14.226526 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7e60016d-49ad-4ec4-a5f5-cb2cb0b9ed98 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:14.232427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7e60016d-49ad-4ec4-a5f5-cb2cb0b9ed98 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:14.234256 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7e60016d-49ad-4ec4-a5f5-cb2cb0b9ed98 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:14.236174 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7e60016d-49ad-4ec4-a5f5-cb2cb0b9ed98 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:14.336056 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-82319eb8-5908-489f-bfbf-24a042b2e4b5 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:14.348539 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-82319eb8-5908-489f-bfbf-24a042b2e4b5 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1271 microversion: 2.1 time: 0.235648 Jul 12 17:26:14.365061 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 34/54] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:14 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1271 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:14.596361 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7e60016d-49ad-4ec4-a5f5-cb2cb0b9ed98 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:14.605493 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7e60016d-49ad-4ec4-a5f5-cb2cb0b9ed98 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1274 microversion: 2.1 time: 0.433734 Jul 12 17:26:14.610610 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 21/55] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:14 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1274 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:15.372674 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-730f54d7-3371-4ace-a9d9-77d8c35d91ec tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:15.374196 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-730f54d7-3371-4ace-a9d9-77d8c35d91ec tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:15.385138 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-730f54d7-3371-4ace-a9d9-77d8c35d91ec tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:15.387821 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-730f54d7-3371-4ace-a9d9-77d8c35d91ec tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:15.390502 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-730f54d7-3371-4ace-a9d9-77d8c35d91ec tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:15.391262 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-730f54d7-3371-4ace-a9d9-77d8c35d91ec tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:15.392599 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:26:15.606386 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c56390f7-3a64-4615-9de6-0456ac079113 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1327053813", "imageRef": "b19e7830-75c9-4706-bd34-4954ba6b4cc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3be9cb9-0ea5-4d05-b64b-1defd294a562"}], "security_groups": [{"name": "tempest-securitygroup--2044058006"}], "key_name": "tempest-keypair-1426069321", "user_data": "}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:26:15.929793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.network.neutron [None req-c56390f7-3a64-4615-9de6-0456ac079113 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] validate_networks() for [('e3be9cb9-0ea5-4d05-b64b-1defd294a562', None, None, None, None, None)] {{(pid=117939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:26:16.044600 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-730f54d7-3371-4ace-a9d9-77d8c35d91ec tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:16.053475 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-730f54d7-3371-4ace-a9d9-77d8c35d91ec tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.686529 Jul 12 17:26:16.054212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 35/56] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:15 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:16.071152 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d913b1d5-2c39-459e-b3ba-8b5f110f07d2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:16.074575 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d913b1d5-2c39-459e-b3ba-8b5f110f07d2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:16.085352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d913b1d5-2c39-459e-b3ba-8b5f110f07d2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:16.085862 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d913b1d5-2c39-459e-b3ba-8b5f110f07d2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:16.086661 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d913b1d5-2c39-459e-b3ba-8b5f110f07d2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:16.087107 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d913b1d5-2c39-459e-b3ba-8b5f110f07d2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:16.194942 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d913b1d5-2c39-459e-b3ba-8b5f110f07d2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:16.204389 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d913b1d5-2c39-459e-b3ba-8b5f110f07d2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1280 microversion: 2.1 time: 0.148762 Jul 12 17:26:16.205658 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 36/57] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:16 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1280 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:16.484779 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cf2531c1-6143-45f4-9515-350e5f97d55d tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] Action: 'create', calling method: .version_select at 0x7f8729d2c700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-489516397", "metadata": {"Type": "work"}}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:26:16.502556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cf2531c1-6143-45f4-9515-350e5f97d55d tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] Request method failure captured: Jul 12 17:26:16.502556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 17:26:16.502556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:26:16.502556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:26:16.502556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:26:16.502556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 121 Jul 12 17:26:16.502556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:26:16.502556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:26:16.502556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:26:16.502556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:26:16.502556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza63G9kVDxwNhFMLCtmFLKIfbHtVnCFdJyHA4iWl5RCyXtKkcH53lr_3ClYeZ_sG-2oup3SmLwHcNnkKB1532FBmUjN-aQgUacnhaxJ_MtrJ3Ibze49anADJQf-MiZslcxo_VKTpmqKSSHsn6dCibtRScfiZcQT1hsLAT46iaHEy8fw Jul 12 17:26:16.502556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:26:16.502556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:26:16.502556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:26:16.502556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:26:16.502556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:26:16.502556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:26:16.502556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: 00e00d4cbe934d3ea79fa563b5df7724 Jul 12 17:26:16.502556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesNegativeTest-1304266521 Jul 12 17:26:16.502556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:26:16.502556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:26:16.503765 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/00e00d4cbe934d3ea79fa563b5df7724"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/00e00d4cbe934d3ea79fa563b5df7724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/00e00d4cbe934d3ea79fa563b5df7724"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_00e00d4cbe934d3ea79fa563b5df7724", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:26:16.503765 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesNegativeTest-1304266521 Jul 12 17:26:16.503765 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 00e00d4cbe934d3ea79fa563b5df7724 Jul 12 17:26:16.503765 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesNegativeTest-1304266521 Jul 12 17:26:16.503765 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesNegativeTest-1304266521-project Jul 12 17:26:16.503765 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:26:16.503765 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:26:16.503765 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: c8fd85fb50e24c9c85d7b7908be82a80 Jul 12 17:26:16.503765 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesNegativeTest-1304266521-project Jul 12 17:26:16.503765 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Jul 12 17:26:16.503765 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-489516397", "metadata": {"Type": "work"}}} Jul 12 17:26:16.503765 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: Jul 12 17:26:16.503765 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-489516397', 'metadata': {'Type': 'work'}}}} Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise error Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi '#$%' Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:26:16.504517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:26:16.505983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:26:16.505983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:26:16.505983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:26:16.505983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:26:16.505983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 17:26:16.505983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 17:26:16.505983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 17:26:16.505983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 17:26:16.505983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 17:26:16.505983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 17:26:16.505983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 17:26:16.505983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.505983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:16.505983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.505983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:16.505983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:26:16.505983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:26:16.505983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 17:26:16.505983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 17:26:16.510044 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 17:26:16.510044 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.510044 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cf2531c1-6143-45f4-9515-350e5f97d55d tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:26:16.510044 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cf2531c1-6143-45f4-9515-350e5f97d55d tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.297250 Jul 12 17:26:16.510044 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 37/58] 10.222.0.62 () {60 vars in 1155 bytes} [Tue Jul 12 17:26:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 303 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 17:26:16.514923 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-52dacc4d-cd2d-422e-ab9a-4535639d30df tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] Action: 'create', calling method: .version_select at 0x7f8729d49550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1255515914", "metadata": {"Type": "work"}}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:26:16.517417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-52dacc4d-cd2d-422e-ab9a-4535639d30df tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] Request method failure captured: Jul 12 17:26:16.517417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 17:26:16.517417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:26:16.517417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:26:16.517417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:26:16.517417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 120 Jul 12 17:26:16.517417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:26:16.517417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:26:16.517417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:26:16.517417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:26:16.517417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza63G9kVDxwNhFMLCtmFLKIfbHtVnCFdJyHA4iWl5RCyXtKkcH53lr_3ClYeZ_sG-2oup3SmLwHcNnkKB1532FBmUjN-aQgUacnhaxJ_MtrJ3Ibze49anADJQf-MiZslcxo_VKTpmqKSSHsn6dCibtRScfiZcQT1hsLAT46iaHEy8fw Jul 12 17:26:16.517417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:26:16.517417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:26:16.517417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:26:16.517417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:26:16.517417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:26:16.517417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:26:16.517417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: 00e00d4cbe934d3ea79fa563b5df7724 Jul 12 17:26:16.517417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesNegativeTest-1304266521 Jul 12 17:26:16.517417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:26:16.517417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:26:16.518643 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/00e00d4cbe934d3ea79fa563b5df7724"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/00e00d4cbe934d3ea79fa563b5df7724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/00e00d4cbe934d3ea79fa563b5df7724"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_00e00d4cbe934d3ea79fa563b5df7724", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:26:16.518643 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesNegativeTest-1304266521 Jul 12 17:26:16.518643 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 00e00d4cbe934d3ea79fa563b5df7724 Jul 12 17:26:16.518643 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesNegativeTest-1304266521 Jul 12 17:26:16.518643 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesNegativeTest-1304266521-project Jul 12 17:26:16.518643 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:26:16.518643 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:26:16.518643 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: c8fd85fb50e24c9c85d7b7908be82a80 Jul 12 17:26:16.518643 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesNegativeTest-1304266521-project Jul 12 17:26:16.518643 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Jul 12 17:26:16.518643 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1255515914", "metadata": {"Type": "work"}}} Jul 12 17:26:16.518643 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: Jul 12 17:26:16.518643 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1255515914', 'metadata': {'Type': 'work'}}}} Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise error Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi '0' Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:26:16.519352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:26:16.520915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:26:16.520915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:26:16.520915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:26:16.520915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:26:16.520915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 17:26:16.520915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 17:26:16.520915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 17:26:16.520915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 17:26:16.520915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 17:26:16.520915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 17:26:16.520915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 17:26:16.520915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.520915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:16.520915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.520915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:16.520915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:26:16.520915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:26:16.520915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 17:26:16.520915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 17:26:16.522167 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 17:26:16.522167 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.522167 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-52dacc4d-cd2d-422e-ab9a-4535639d30df tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:26:16.522167 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-52dacc4d-cd2d-422e-ab9a-4535639d30df tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008364 Jul 12 17:26:16.524034 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 38/59] 10.222.0.62 () {60 vars in 1155 bytes} [Tue Jul 12 17:26:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 17:26:16.529982 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c0e1a95b-bdb1-4266-80c5-203e060a36e1 tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] Action: 'create', calling method: .version_select at 0x7f8729d89550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-591075228", "metadata": {"Type": "work"}}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:26:16.534879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c0e1a95b-bdb1-4266-80c5-203e060a36e1 tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] Request method failure captured: Jul 12 17:26:16.534879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 17:26:16.534879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:26:16.534879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:26:16.534879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:26:16.534879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 118 Jul 12 17:26:16.534879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:26:16.534879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:26:16.534879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:26:16.534879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:26:16.534879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza63G9kVDxwNhFMLCtmFLKIfbHtVnCFdJyHA4iWl5RCyXtKkcH53lr_3ClYeZ_sG-2oup3SmLwHcNnkKB1532FBmUjN-aQgUacnhaxJ_MtrJ3Ibze49anADJQf-MiZslcxo_VKTpmqKSSHsn6dCibtRScfiZcQT1hsLAT46iaHEy8fw Jul 12 17:26:16.534879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:26:16.534879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:26:16.534879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:26:16.534879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:26:16.534879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:26:16.534879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:26:16.534879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: 00e00d4cbe934d3ea79fa563b5df7724 Jul 12 17:26:16.534879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesNegativeTest-1304266521 Jul 12 17:26:16.534879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:26:16.534879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:26:16.535975 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/00e00d4cbe934d3ea79fa563b5df7724"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/00e00d4cbe934d3ea79fa563b5df7724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/00e00d4cbe934d3ea79fa563b5df7724"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_00e00d4cbe934d3ea79fa563b5df7724", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:26:16.535975 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesNegativeTest-1304266521 Jul 12 17:26:16.535975 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 00e00d4cbe934d3ea79fa563b5df7724 Jul 12 17:26:16.535975 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesNegativeTest-1304266521 Jul 12 17:26:16.535975 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesNegativeTest-1304266521-project Jul 12 17:26:16.535975 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:26:16.535975 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:26:16.535975 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: c8fd85fb50e24c9c85d7b7908be82a80 Jul 12 17:26:16.535975 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesNegativeTest-1304266521-project Jul 12 17:26:16.535975 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Jul 12 17:26:16.535975 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-591075228", "metadata": {"Type": "work"}}} Jul 12 17:26:16.535975 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: Jul 12 17:26:16.535975 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-591075228', 'metadata': {'Type': 'work'}}}} Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise error Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi '' Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:26:16.536771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:26:16.538241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:26:16.538241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:26:16.538241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:26:16.538241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:26:16.538241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 17:26:16.538241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 17:26:16.538241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 17:26:16.538241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 17:26:16.538241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 17:26:16.538241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 17:26:16.538241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 17:26:16.538241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.538241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:16.538241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.538241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:16.538241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:26:16.538241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:26:16.538241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 17:26:16.538241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 17:26:16.539177 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 17:26:16.539177 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.541045 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c0e1a95b-bdb1-4266-80c5-203e060a36e1 tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:26:16.542042 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c0e1a95b-bdb1-4266-80c5-203e060a36e1 tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015716 Jul 12 17:26:16.542559 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 39/60] 10.222.0.62 () {60 vars in 1155 bytes} [Tue Jul 12 17:26:16 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 17:26:16.552102 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5d393902-07ba-4df8-81d2-943b2cd56c75 tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] Calling method '.version_select at 0x7f8729dea9d0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:16.584642 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-5d393902-07ba-4df8-81d2-943b2cd56c75 tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] HTTP exception thrown: Volume tempest-invalid-464783321 could not be found. Jul 12 17:26:16.586749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5d393902-07ba-4df8-81d2-943b2cd56c75 tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] Request method failure captured: Jul 12 17:26:16.586749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-464783321 HTTP/1.1 Jul 12 17:26:16.586749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:26:16.586749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:26:16.586749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:26:16.586749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:26:16.586749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:26:16.586749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:26:16.586749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:26:16.586749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:26:16.586749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza63G9kVDxwNhFMLCtmFLKIfbHtVnCFdJyHA4iWl5RCyXtKkcH53lr_3ClYeZ_sG-2oup3SmLwHcNnkKB1532FBmUjN-aQgUacnhaxJ_MtrJ3Ibze49anADJQf-MiZslcxo_VKTpmqKSSHsn6dCibtRScfiZcQT1hsLAT46iaHEy8fw Jul 12 17:26:16.586749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:26:16.586749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:26:16.586749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:26:16.586749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:26:16.586749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:26:16.586749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:26:16.586749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: 00e00d4cbe934d3ea79fa563b5df7724 Jul 12 17:26:16.586749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesNegativeTest-1304266521 Jul 12 17:26:16.586749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:26:16.586749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:26:16.587843 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/00e00d4cbe934d3ea79fa563b5df7724"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/00e00d4cbe934d3ea79fa563b5df7724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/00e00d4cbe934d3ea79fa563b5df7724"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_00e00d4cbe934d3ea79fa563b5df7724", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:26:16.587843 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesNegativeTest-1304266521 Jul 12 17:26:16.587843 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 00e00d4cbe934d3ea79fa563b5df7724 Jul 12 17:26:16.587843 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesNegativeTest-1304266521 Jul 12 17:26:16.587843 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesNegativeTest-1304266521-project Jul 12 17:26:16.587843 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:26:16.587843 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:26:16.587843 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: c8fd85fb50e24c9c85d7b7908be82a80 Jul 12 17:26:16.587843 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesNegativeTest-1304266521-project Jul 12 17:26:16.587843 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: Jul 12 17:26:16.587843 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Volume tempest-invalid-464783321 could not be found. Jul 12 17:26:16.587843 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': 'tempest-invalid-464783321'} Jul 12 17:26:16.587843 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:26:16.588527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:16.588527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:26:16.588527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:26:16.588527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 17:26:16.588527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 17:26:16.588527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 17:26:16.588527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 17:26:16.588527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 17:26:16.588527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 17:26:16.588527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 17:26:16.588527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 17:26:16.588527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:26:16.588527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:26:16.588527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:26:16.588527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:26:16.588527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-464783321 could not be found. (HTTP 404) (Request-ID: req-522295de-d959-484f-a273-1150ce5a724e) Jul 12 17:26:16.588527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.588527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:16.588527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.589538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:16.589538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 17:26:16.589538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 17:26:16.589538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 17:26:16.589538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 17:26:16.589538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 17:26:16.589538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 17:26:16.589538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 17:26:16.589538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 17:26:16.589538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:26:16.589538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:26:16.589538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 17:26:16.589538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 17:26:16.589538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 17:26:16.589538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 17:26:16.589538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 17:26:16.589538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 17:26:16.589538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 17:26:16.589538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 17:26:16.590492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:26:16.590492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:26:16.590492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:26:16.590492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:26:16.590492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-464783321 could not be found. Jul 12 17:26:16.590492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.590492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:16.590492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.590492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:16.590492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:26:16.590492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:26:16.590492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:26:16.590492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:26:16.590492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:26:16.590492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:26:16.590492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:26:16.590492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:26:16.590492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 17:26:16.590492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:26:16.590492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-464783321 could not be found. Jul 12 17:26:16.591460 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.591460 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:16.591460 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.591460 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:16.591460 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:26:16.591460 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:26:16.591460 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:26:16.591460 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:26:16.591460 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-464783321 could not be found. Jul 12 17:26:16.591460 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.591460 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5d393902-07ba-4df8-81d2-943b2cd56c75 tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] Returning 404 to user: Volume tempest-invalid-464783321 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:26:16.591460 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5d393902-07ba-4df8-81d2-943b2cd56c75 tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/tempest-invalid-464783321" status: 404 len: 98 microversion: 2.1 time: 0.040368 Jul 12 17:26:16.592722 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 40/61] 10.222.0.62 () {58 vars in 1214 bytes} [Tue Jul 12 17:26:16 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-464783321 => generated 98 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 17:26:16.598158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d3adb0a1-15be-4415-ad1d-c80a5af37d5c tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004353 Jul 12 17:26:16.598667 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 41/62] 10.222.0.62 () {58 vars in 1139 bytes} [Tue Jul 12 17:26:16 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 17:26:16.608070 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-01428e53-64d0-423e-8a95-9bb03109df66 tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003647 Jul 12 17:26:16.610056 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 42/63] 10.222.0.62 () {58 vars in 1136 bytes} [Tue Jul 12 17:26:16 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 12 17:26:16.619267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7e9e8428-900c-455e-ae9e-f01eeb454a34 tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] Calling method '.version_select at 0x7f8729d2c9d0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:16.656435 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-7e9e8428-900c-455e-ae9e-f01eeb454a34 tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] HTTP exception thrown: Volume 8d7d9b92-0018-4731-a47a-2a3363f983bf could not be found. Jul 12 17:26:16.659245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7e9e8428-900c-455e-ae9e-f01eeb454a34 tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] Request method failure captured: Jul 12 17:26:16.659245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/os-volumes/8d7d9b92-0018-4731-a47a-2a3363f983bf HTTP/1.1 Jul 12 17:26:16.659245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:26:16.659245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:26:16.659245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:26:16.659245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:26:16.659245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:26:16.659245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:26:16.659245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:26:16.659245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:26:16.659245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza63G9kVDxwNhFMLCtmFLKIfbHtVnCFdJyHA4iWl5RCyXtKkcH53lr_3ClYeZ_sG-2oup3SmLwHcNnkKB1532FBmUjN-aQgUacnhaxJ_MtrJ3Ibze49anADJQf-MiZslcxo_VKTpmqKSSHsn6dCibtRScfiZcQT1hsLAT46iaHEy8fw Jul 12 17:26:16.659245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:26:16.659245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:26:16.659245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:26:16.659245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:26:16.659245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:26:16.659245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:26:16.659245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: 00e00d4cbe934d3ea79fa563b5df7724 Jul 12 17:26:16.659245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesNegativeTest-1304266521 Jul 12 17:26:16.659245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:26:16.659245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:26:16.660389 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/00e00d4cbe934d3ea79fa563b5df7724"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/00e00d4cbe934d3ea79fa563b5df7724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/00e00d4cbe934d3ea79fa563b5df7724"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_00e00d4cbe934d3ea79fa563b5df7724", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:26:16.660389 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesNegativeTest-1304266521 Jul 12 17:26:16.660389 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 00e00d4cbe934d3ea79fa563b5df7724 Jul 12 17:26:16.660389 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesNegativeTest-1304266521 Jul 12 17:26:16.660389 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesNegativeTest-1304266521-project Jul 12 17:26:16.660389 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:26:16.660389 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:26:16.660389 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: c8fd85fb50e24c9c85d7b7908be82a80 Jul 12 17:26:16.660389 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesNegativeTest-1304266521-project Jul 12 17:26:16.660389 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: Jul 12 17:26:16.660389 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Volume 8d7d9b92-0018-4731-a47a-2a3363f983bf could not be found. Jul 12 17:26:16.660389 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': '8d7d9b92-0018-4731-a47a-2a3363f983bf'} Jul 12 17:26:16.660389 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:26:16.661134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:16.661134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:26:16.661134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:26:16.661134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 17:26:16.661134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 17:26:16.661134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 17:26:16.661134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 17:26:16.661134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 17:26:16.661134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 17:26:16.661134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 17:26:16.661134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 17:26:16.661134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:26:16.661134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:26:16.661134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:26:16.661134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:26:16.661134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8d7d9b92-0018-4731-a47a-2a3363f983bf could not be found. (HTTP 404) (Request-ID: req-703a5ec6-ee04-48c6-bfd6-b5bc3ba506ed) Jul 12 17:26:16.661134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.661134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:16.661134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.662218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:16.662218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 17:26:16.662218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 17:26:16.662218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 17:26:16.662218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 17:26:16.662218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 17:26:16.662218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 17:26:16.662218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 17:26:16.662218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 17:26:16.662218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:26:16.662218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:26:16.662218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 17:26:16.662218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 17:26:16.662218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 17:26:16.662218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 17:26:16.662218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 17:26:16.662218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 17:26:16.662218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 17:26:16.662218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 17:26:16.663774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:26:16.663774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:26:16.663774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:26:16.663774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:26:16.663774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8d7d9b92-0018-4731-a47a-2a3363f983bf could not be found. Jul 12 17:26:16.663774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.663774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:16.663774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.663774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:16.663774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:26:16.663774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:26:16.663774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:26:16.663774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:26:16.663774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:26:16.663774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:26:16.663774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:26:16.663774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:26:16.663774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 17:26:16.663774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:26:16.664719 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8d7d9b92-0018-4731-a47a-2a3363f983bf could not be found. Jul 12 17:26:16.664719 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.664719 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:16.664719 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.664719 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:16.664719 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:26:16.664719 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:26:16.664719 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:26:16.664719 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:26:16.664719 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8d7d9b92-0018-4731-a47a-2a3363f983bf could not be found. Jul 12 17:26:16.664719 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.664719 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7e9e8428-900c-455e-ae9e-f01eeb454a34 tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] Returning 404 to user: Volume 8d7d9b92-0018-4731-a47a-2a3363f983bf could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:26:16.664719 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7e9e8428-900c-455e-ae9e-f01eeb454a34 tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/8d7d9b92-0018-4731-a47a-2a3363f983bf" status: 404 len: 109 microversion: 2.1 time: 0.047023 Jul 12 17:26:16.664719 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 43/64] 10.222.0.62 () {58 vars in 1247 bytes} [Tue Jul 12 17:26:16 2022] DELETE /compute/v2.1/os-volumes/8d7d9b92-0018-4731-a47a-2a3363f983bf => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:26:16.672789 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e44f2a3f-23db-448a-961b-e145a5521285 tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] Calling method '.version_select at 0x7f8729d49820>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:16.704223 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-e44f2a3f-23db-448a-961b-e145a5521285 tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] HTTP exception thrown: Volume 44297cd0-5b1a-473c-a94b-8ece3415c281 could not be found. Jul 12 17:26:16.706181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e44f2a3f-23db-448a-961b-e145a5521285 tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] Request method failure captured: Jul 12 17:26:16.706181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/os-volumes/44297cd0-5b1a-473c-a94b-8ece3415c281 HTTP/1.1 Jul 12 17:26:16.706181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:26:16.706181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:26:16.706181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:26:16.706181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:26:16.706181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:26:16.706181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:26:16.706181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:26:16.706181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:26:16.706181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza63G9kVDxwNhFMLCtmFLKIfbHtVnCFdJyHA4iWl5RCyXtKkcH53lr_3ClYeZ_sG-2oup3SmLwHcNnkKB1532FBmUjN-aQgUacnhaxJ_MtrJ3Ibze49anADJQf-MiZslcxo_VKTpmqKSSHsn6dCibtRScfiZcQT1hsLAT46iaHEy8fw Jul 12 17:26:16.706181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:26:16.706181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:26:16.706181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:26:16.706181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:26:16.706181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:26:16.706181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:26:16.706181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: 00e00d4cbe934d3ea79fa563b5df7724 Jul 12 17:26:16.706181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesNegativeTest-1304266521 Jul 12 17:26:16.706181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:26:16.706181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:26:16.707269 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/00e00d4cbe934d3ea79fa563b5df7724"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/00e00d4cbe934d3ea79fa563b5df7724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/00e00d4cbe934d3ea79fa563b5df7724"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_00e00d4cbe934d3ea79fa563b5df7724", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:26:16.707269 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesNegativeTest-1304266521 Jul 12 17:26:16.707269 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 00e00d4cbe934d3ea79fa563b5df7724 Jul 12 17:26:16.707269 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesNegativeTest-1304266521 Jul 12 17:26:16.707269 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesNegativeTest-1304266521-project Jul 12 17:26:16.707269 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:26:16.707269 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:26:16.707269 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: c8fd85fb50e24c9c85d7b7908be82a80 Jul 12 17:26:16.707269 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesNegativeTest-1304266521-project Jul 12 17:26:16.707269 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: Jul 12 17:26:16.707269 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Volume 44297cd0-5b1a-473c-a94b-8ece3415c281 could not be found. Jul 12 17:26:16.707269 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': '44297cd0-5b1a-473c-a94b-8ece3415c281'} Jul 12 17:26:16.707269 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:26:16.707964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:16.707964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:26:16.707964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:26:16.707964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 17:26:16.707964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 17:26:16.707964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 17:26:16.707964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 17:26:16.707964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 17:26:16.707964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 17:26:16.707964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 17:26:16.707964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 17:26:16.707964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:26:16.707964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:26:16.707964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:26:16.707964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:26:16.707964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 44297cd0-5b1a-473c-a94b-8ece3415c281 could not be found. (HTTP 404) (Request-ID: req-f443f25c-9841-4c73-ad34-9e3a11b05501) Jul 12 17:26:16.707964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.707964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:16.707964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.708950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:16.708950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 17:26:16.708950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 17:26:16.708950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 17:26:16.708950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 17:26:16.708950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 17:26:16.708950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 17:26:16.708950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 17:26:16.708950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 17:26:16.708950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 17:26:16.708950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 17:26:16.708950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 17:26:16.708950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 17:26:16.708950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 17:26:16.708950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 17:26:16.708950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 17:26:16.708950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 17:26:16.708950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 17:26:16.708950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 17:26:16.710259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 17:26:16.710259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 17:26:16.710259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 17:26:16.710259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 17:26:16.710259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 44297cd0-5b1a-473c-a94b-8ece3415c281 could not be found. Jul 12 17:26:16.710259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.710259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:16.710259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.710259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:16.710259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:26:16.710259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:26:16.710259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:26:16.710259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:26:16.710259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 17:26:16.710259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 17:26:16.710259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:26:16.710259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:26:16.710259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 17:26:16.710259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:26:16.711215 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 44297cd0-5b1a-473c-a94b-8ece3415c281 could not be found. Jul 12 17:26:16.711215 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.711215 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:26:16.711215 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.711215 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:26:16.711215 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:26:16.711215 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:26:16.711215 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:26:16.711215 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:26:16.711215 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 44297cd0-5b1a-473c-a94b-8ece3415c281 could not be found. Jul 12 17:26:16.711215 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:26:16.711215 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e44f2a3f-23db-448a-961b-e145a5521285 tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] Returning 404 to user: Volume 44297cd0-5b1a-473c-a94b-8ece3415c281 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:26:16.711215 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e44f2a3f-23db-448a-961b-e145a5521285 tempest-VolumesNegativeTest-1304266521 tempest-VolumesNegativeTest-1304266521-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/44297cd0-5b1a-473c-a94b-8ece3415c281" status: 404 len: 109 microversion: 2.1 time: 0.038673 Jul 12 17:26:16.711215 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 44/65] 10.222.0.62 () {58 vars in 1244 bytes} [Tue Jul 12 17:26:16 2022] GET /compute/v2.1/os-volumes/44297cd0-5b1a-473c-a94b-8ece3415c281 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:26:17.072483 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-05da492f-ef58-4de4-b627-a2faea08f5fd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:17.073710 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-05da492f-ef58-4de4-b627-a2faea08f5fd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:17.080993 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-05da492f-ef58-4de4-b627-a2faea08f5fd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:17.081875 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-05da492f-ef58-4de4-b627-a2faea08f5fd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:17.083152 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-05da492f-ef58-4de4-b627-a2faea08f5fd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:17.083941 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-05da492f-ef58-4de4-b627-a2faea08f5fd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:17.110635 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-c56390f7-3a64-4615-9de6-0456ac079113 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Flavor limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:26:17.113469 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-c56390f7-3a64-4615-9de6-0456ac079113 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Image limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:26:17.114522 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-c56390f7-3a64-4615-9de6-0456ac079113 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Flavor pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:26:17.123663 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-c56390f7-3a64-4615-9de6-0456ac079113 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Image pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:26:17.125395 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-c56390f7-3a64-4615-9de6-0456ac079113 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:26:17.149851 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c56390f7-3a64-4615-9de6-0456ac079113 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:17.151107 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c56390f7-3a64-4615-9de6-0456ac079113 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:17.154856 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c56390f7-3a64-4615-9de6-0456ac079113 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:17.156809 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c56390f7-3a64-4615-9de6-0456ac079113 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:17.188763 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-c56390f7-3a64-4615-9de6-0456ac079113 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Getting quotas for project 4a4e837b171b4b4a9c2ad230cda53452. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:26:17.194805 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-c56390f7-3a64-4615-9de6-0456ac079113 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Getting quotas for user 38a74ebdd59a491386aedcdbd312b363 and project 4a4e837b171b4b4a9c2ad230cda53452. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:26:17.215894 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c56390f7-3a64-4615-9de6-0456ac079113 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Going to run 1 instances... {{(pid=117939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:26:17.223281 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c56390f7-3a64-4615-9de6-0456ac079113 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19e7830-75c9-4706-bd34-4954ba6b4cc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:26:17.312016 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c56390f7-3a64-4615-9de6-0456ac079113 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.710704 Jul 12 17:26:17.318486 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 22/66] 10.222.0.62 () {60 vars in 1146 bytes} [Tue Jul 12 17:26:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 1719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:26:17.324902 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e5642920-7024-41b1-9b99-53524620c7d0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:17.325828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e5642920-7024-41b1-9b99-53524620c7d0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:17.332477 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e5642920-7024-41b1-9b99-53524620c7d0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:17.333211 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e5642920-7024-41b1-9b99-53524620c7d0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:17.334857 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e5642920-7024-41b1-9b99-53524620c7d0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:17.335489 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e5642920-7024-41b1-9b99-53524620c7d0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:17.902135 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-05da492f-ef58-4de4-b627-a2faea08f5fd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:17.914183 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-05da492f-ef58-4de4-b627-a2faea08f5fd tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.844381 Jul 12 17:26:17.917098 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 45/67] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:17 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:17.937765 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6e1541fc-72ad-47b3-9c10-b3f3643c28bd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:17.940292 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6e1541fc-72ad-47b3-9c10-b3f3643c28bd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:18.066422 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e5642920-7024-41b1-9b99-53524620c7d0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:18.075930 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e5642920-7024-41b1-9b99-53524620c7d0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.755979 Jul 12 17:26:18.082529 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 23/68] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:17 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:18.147293 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6e1541fc-72ad-47b3-9c10-b3f3643c28bd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:18.159068 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6e1541fc-72ad-47b3-9c10-b3f3643c28bd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1242 microversion: 2.1 time: 0.238922 Jul 12 17:26:18.163481 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 46/69] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:17 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1242 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:18.361516 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-c0f1f247-f172-4f37-aeae-75668473f4cc req-1b895f63-fe11-4f16-bf8a-02e812748fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4d99e1a-efd3-4510-ac75-1c21c7937044", "tag": "139b5be4-a836-4dac-8cf5-8f90d7599330"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:26:18.374830 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-c0f1f247-f172-4f37-aeae-75668473f4cc req-1b895f63-fe11-4f16-bf8a-02e812748fd9 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:18.375508 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-c0f1f247-f172-4f37-aeae-75668473f4cc req-1b895f63-fe11-4f16-bf8a-02e812748fd9 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:18.397134 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-c0f1f247-f172-4f37-aeae-75668473f4cc req-1b895f63-fe11-4f16-bf8a-02e812748fd9 service nova] Creating event network-changed:139b5be4-a836-4dac-8cf5-8f90d7599330 for instance f4d99e1a-efd3-4510-ac75-1c21c7937044 on hv-cinder-84932 Jul 12 17:26:18.397671 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-c0f1f247-f172-4f37-aeae-75668473f4cc req-1b895f63-fe11-4f16-bf8a-02e812748fd9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117939) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 17:26:18.398831 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ff36827e-9455-4c3f-a663-edf618988750 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:18.399269 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ff36827e-9455-4c3f-a663-edf618988750 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:18.400049 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ff36827e-9455-4c3f-a663-edf618988750 None None] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:18.400477 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ff36827e-9455-4c3f-a663-edf618988750 None None] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:18.409325 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.compute.rpcapi [None req-ff36827e-9455-4c3f-a663-edf618988750 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 17:26:18.411080 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ff36827e-9455-4c3f-a663-edf618988750 None None] Releasing lock "compute-rpcapi-router" {{(pid=117939) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 17:26:18.431749 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ff36827e-9455-4c3f-a663-edf618988750 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156657 Jul 12 17:26:18.432941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 24/70] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:26:18.935097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ab8e4fa3-2bba-4145-9e54-445d67f1abd7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:18.935713 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ab8e4fa3-2bba-4145-9e54-445d67f1abd7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:18.942862 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ab8e4fa3-2bba-4145-9e54-445d67f1abd7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:18.943268 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ab8e4fa3-2bba-4145-9e54-445d67f1abd7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:18.944845 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ab8e4fa3-2bba-4145-9e54-445d67f1abd7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:18.945432 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ab8e4fa3-2bba-4145-9e54-445d67f1abd7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:19.089068 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ab8e4fa3-2bba-4145-9e54-445d67f1abd7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:19.097580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ab8e4fa3-2bba-4145-9e54-445d67f1abd7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.166377 Jul 12 17:26:19.098692 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 47/71] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:18 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:19.114185 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-066be6ad-eb0f-4d4d-90cf-e2e81c3b1a71 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:19.114943 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-066be6ad-eb0f-4d4d-90cf-e2e81c3b1a71 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:19.127399 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-066be6ad-eb0f-4d4d-90cf-e2e81c3b1a71 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:19.128152 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-066be6ad-eb0f-4d4d-90cf-e2e81c3b1a71 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:19.129164 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-066be6ad-eb0f-4d4d-90cf-e2e81c3b1a71 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:19.129830 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-066be6ad-eb0f-4d4d-90cf-e2e81c3b1a71 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:19.195357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-55ac2e63-6713-4bdf-8871-312b1cc70b87 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:19.200037 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-55ac2e63-6713-4bdf-8871-312b1cc70b87 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:19.206563 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-55ac2e63-6713-4bdf-8871-312b1cc70b87 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:19.207496 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-55ac2e63-6713-4bdf-8871-312b1cc70b87 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:19.209248 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-55ac2e63-6713-4bdf-8871-312b1cc70b87 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:19.210782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-55ac2e63-6713-4bdf-8871-312b1cc70b87 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:19.355424 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-55ac2e63-6713-4bdf-8871-312b1cc70b87 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:19.366042 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-066be6ad-eb0f-4d4d-90cf-e2e81c3b1a71 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:19.369304 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-55ac2e63-6713-4bdf-8871-312b1cc70b87 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1246 microversion: 2.1 time: 0.188390 Jul 12 17:26:19.370069 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 48/72] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:19 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1246 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:26:19.376341 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-066be6ad-eb0f-4d4d-90cf-e2e81c3b1a71 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.274572 Jul 12 17:26:19.377846 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 25/73] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:19 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:26:20.137646 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-05d36e5f-bd14-447c-bc35-ead5112cea7f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:20.139003 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-05d36e5f-bd14-447c-bc35-ead5112cea7f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:20.178099 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-05d36e5f-bd14-447c-bc35-ead5112cea7f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:20.178652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-05d36e5f-bd14-447c-bc35-ead5112cea7f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:20.179437 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-05d36e5f-bd14-447c-bc35-ead5112cea7f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:20.179851 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-05d36e5f-bd14-447c-bc35-ead5112cea7f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:20.391870 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4895a4cf-81d8-426b-a138-5b8dcc97270f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:20.393609 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4895a4cf-81d8-426b-a138-5b8dcc97270f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:20.395331 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-05d36e5f-bd14-447c-bc35-ead5112cea7f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:20.405524 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-05d36e5f-bd14-447c-bc35-ead5112cea7f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.294960 Jul 12 17:26:20.406779 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 49/74] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:20 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:20.411382 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4895a4cf-81d8-426b-a138-5b8dcc97270f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:20.411863 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4895a4cf-81d8-426b-a138-5b8dcc97270f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:20.412322 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-19d28db0-b979-45c9-89f1-9001f3229d03 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:20.412699 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4895a4cf-81d8-426b-a138-5b8dcc97270f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:20.412936 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-19d28db0-b979-45c9-89f1-9001f3229d03 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:20.413133 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4895a4cf-81d8-426b-a138-5b8dcc97270f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:20.420285 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-19d28db0-b979-45c9-89f1-9001f3229d03 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:20.420961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-19d28db0-b979-45c9-89f1-9001f3229d03 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:20.422240 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-19d28db0-b979-45c9-89f1-9001f3229d03 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:20.422929 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-19d28db0-b979-45c9-89f1-9001f3229d03 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:20.573258 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4895a4cf-81d8-426b-a138-5b8dcc97270f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:20.588103 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4895a4cf-81d8-426b-a138-5b8dcc97270f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1246 microversion: 2.1 time: 0.203743 Jul 12 17:26:20.590123 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 26/75] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:20 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1246 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:20.687345 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-19d28db0-b979-45c9-89f1-9001f3229d03 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:20.697316 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-19d28db0-b979-45c9-89f1-9001f3229d03 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.288877 Jul 12 17:26:20.708293 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 50/76] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:20 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:21.424299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-81fb9085-d3c1-4c25-9a70-58d08188e9ed tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:21.425529 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-81fb9085-d3c1-4c25-9a70-58d08188e9ed tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:21.447271 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-81fb9085-d3c1-4c25-9a70-58d08188e9ed tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:21.447995 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-81fb9085-d3c1-4c25-9a70-58d08188e9ed tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:21.451021 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-81fb9085-d3c1-4c25-9a70-58d08188e9ed tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:21.451684 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-81fb9085-d3c1-4c25-9a70-58d08188e9ed tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:21.607956 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d0cab848-1cfd-4012-bc3c-a6a33bf3fdfc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:21.609090 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d0cab848-1cfd-4012-bc3c-a6a33bf3fdfc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:21.616183 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0cab848-1cfd-4012-bc3c-a6a33bf3fdfc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:21.625018 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0cab848-1cfd-4012-bc3c-a6a33bf3fdfc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:21.628079 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0cab848-1cfd-4012-bc3c-a6a33bf3fdfc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:21.629269 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0cab848-1cfd-4012-bc3c-a6a33bf3fdfc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:21.834941 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d0cab848-1cfd-4012-bc3c-a6a33bf3fdfc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:21.848085 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d0cab848-1cfd-4012-bc3c-a6a33bf3fdfc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1246 microversion: 2.1 time: 0.245268 Jul 12 17:26:21.850650 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 51/77] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:21 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1246 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:21.870362 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ce6b6243-9c27-4017-a472-f4dc646d9dd7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:21.871342 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ce6b6243-9c27-4017-a472-f4dc646d9dd7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:21.887862 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ce6b6243-9c27-4017-a472-f4dc646d9dd7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:21.889993 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ce6b6243-9c27-4017-a472-f4dc646d9dd7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:21.892065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ce6b6243-9c27-4017-a472-f4dc646d9dd7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:21.893415 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ce6b6243-9c27-4017-a472-f4dc646d9dd7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:21.930364 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-81fb9085-d3c1-4c25-9a70-58d08188e9ed tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:21.947852 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-81fb9085-d3c1-4c25-9a70-58d08188e9ed tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.525954 Jul 12 17:26:21.950563 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 27/78] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:21 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:22.205016 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ce6b6243-9c27-4017-a472-f4dc646d9dd7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:22.215249 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ce6b6243-9c27-4017-a472-f4dc646d9dd7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.363210 Jul 12 17:26:22.226830 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 52/79] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:21 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:22.868488 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-289b5144-0991-4c58-a806-2782f213dee2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:22.870118 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-289b5144-0991-4c58-a806-2782f213dee2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:22.879120 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-289b5144-0991-4c58-a806-2782f213dee2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:22.880267 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-289b5144-0991-4c58-a806-2782f213dee2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:22.882012 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-289b5144-0991-4c58-a806-2782f213dee2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:22.883639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-289b5144-0991-4c58-a806-2782f213dee2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:22.966848 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-16c7fc0c-1726-46f2-b3ba-36b8c55ee611 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:22.967468 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-16c7fc0c-1726-46f2-b3ba-36b8c55ee611 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:22.989531 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-16c7fc0c-1726-46f2-b3ba-36b8c55ee611 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:22.990050 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-16c7fc0c-1726-46f2-b3ba-36b8c55ee611 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:22.997610 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-16c7fc0c-1726-46f2-b3ba-36b8c55ee611 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:22.999564 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-16c7fc0c-1726-46f2-b3ba-36b8c55ee611 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:23.009545 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-289b5144-0991-4c58-a806-2782f213dee2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:23.024174 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-289b5144-0991-4c58-a806-2782f213dee2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1246 microversion: 2.1 time: 0.160578 Jul 12 17:26:23.036948 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 28/80] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:22 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1246 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:23.242840 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5430b538-a83a-408a-924c-d2d8fe1d8999 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:23.243838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5430b538-a83a-408a-924c-d2d8fe1d8999 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:23.250653 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5430b538-a83a-408a-924c-d2d8fe1d8999 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:23.251168 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5430b538-a83a-408a-924c-d2d8fe1d8999 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:23.251968 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5430b538-a83a-408a-924c-d2d8fe1d8999 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:23.252426 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5430b538-a83a-408a-924c-d2d8fe1d8999 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:23.292388 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-16c7fc0c-1726-46f2-b3ba-36b8c55ee611 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:23.300683 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-16c7fc0c-1726-46f2-b3ba-36b8c55ee611 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.339265 Jul 12 17:26:23.301266 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 53/81] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:22 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:23.445549 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5430b538-a83a-408a-924c-d2d8fe1d8999 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:23.458316 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5430b538-a83a-408a-924c-d2d8fe1d8999 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.227583 Jul 12 17:26:23.459073 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 29/82] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:23 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:26:24.044187 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3902f3b3-8738-4a07-855b-3051665d494e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:24.045430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3902f3b3-8738-4a07-855b-3051665d494e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:24.053589 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3902f3b3-8738-4a07-855b-3051665d494e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:24.054390 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3902f3b3-8738-4a07-855b-3051665d494e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:24.056110 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3902f3b3-8738-4a07-855b-3051665d494e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:24.056918 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3902f3b3-8738-4a07-855b-3051665d494e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:24.208469 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3902f3b3-8738-4a07-855b-3051665d494e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:24.239069 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3902f3b3-8738-4a07-855b-3051665d494e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1246 microversion: 2.1 time: 0.199101 Jul 12 17:26:24.239673 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 54/83] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:24 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1246 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:24.323043 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-28784d96-1714-4956-9e00-d858f1ae0582 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:24.323998 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-28784d96-1714-4956-9e00-d858f1ae0582 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:24.340898 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-28784d96-1714-4956-9e00-d858f1ae0582 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:24.341500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-28784d96-1714-4956-9e00-d858f1ae0582 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:24.342511 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-28784d96-1714-4956-9e00-d858f1ae0582 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:24.344754 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-28784d96-1714-4956-9e00-d858f1ae0582 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:24.479738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7f84dd40-4246-486f-9fef-da76848bf00d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:24.480615 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7f84dd40-4246-486f-9fef-da76848bf00d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:24.489497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7f84dd40-4246-486f-9fef-da76848bf00d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:24.489996 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7f84dd40-4246-486f-9fef-da76848bf00d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:24.493524 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7f84dd40-4246-486f-9fef-da76848bf00d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:24.494004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7f84dd40-4246-486f-9fef-da76848bf00d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:24.735097 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-28784d96-1714-4956-9e00-d858f1ae0582 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:24.755910 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-28784d96-1714-4956-9e00-d858f1ae0582 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.430848 Jul 12 17:26:24.755910 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 30/84] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:24 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:24.788959 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7f84dd40-4246-486f-9fef-da76848bf00d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:24.799442 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7f84dd40-4246-486f-9fef-da76848bf00d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.327795 Jul 12 17:26:24.801009 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 55/85] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:24 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:25.256862 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9d108324-399e-4048-89e3-65086770070f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:25.257706 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9d108324-399e-4048-89e3-65086770070f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:25.267467 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9d108324-399e-4048-89e3-65086770070f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:25.270179 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9d108324-399e-4048-89e3-65086770070f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:25.271167 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9d108324-399e-4048-89e3-65086770070f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:25.273620 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9d108324-399e-4048-89e3-65086770070f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:25.635261 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9d108324-399e-4048-89e3-65086770070f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:25.658200 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9d108324-399e-4048-89e3-65086770070f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1246 microversion: 2.1 time: 0.397513 Jul 12 17:26:25.659116 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 31/86] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:25 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1246 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:25.774942 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9705e780-e2e5-4121-9ec6-5353348fca6f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:25.781457 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9705e780-e2e5-4121-9ec6-5353348fca6f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:25.803622 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9705e780-e2e5-4121-9ec6-5353348fca6f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:25.817500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0b6cfcf4-df0a-41ab-8470-3def54b986fd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:25.819539 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0b6cfcf4-df0a-41ab-8470-3def54b986fd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:25.822909 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9705e780-e2e5-4121-9ec6-5353348fca6f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:25.823861 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9705e780-e2e5-4121-9ec6-5353348fca6f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:25.824278 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9705e780-e2e5-4121-9ec6-5353348fca6f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:25.837248 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0b6cfcf4-df0a-41ab-8470-3def54b986fd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:25.839026 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0b6cfcf4-df0a-41ab-8470-3def54b986fd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:25.843139 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0b6cfcf4-df0a-41ab-8470-3def54b986fd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:25.843653 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0b6cfcf4-df0a-41ab-8470-3def54b986fd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:25.854519 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:26:26.301379 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0b6cfcf4-df0a-41ab-8470-3def54b986fd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:26.314354 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0b6cfcf4-df0a-41ab-8470-3def54b986fd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.497246 Jul 12 17:26:26.315781 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 32/87] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:25 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:26.344658 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9705e780-e2e5-4121-9ec6-5353348fca6f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:26.353230 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9705e780-e2e5-4121-9ec6-5353348fca6f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.583301 Jul 12 17:26:26.360584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 56/88] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:25 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:26.682009 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-62bf2d61-a24b-46a4-b70f-b082ed0a1b00 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:26.685626 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-62bf2d61-a24b-46a4-b70f-b082ed0a1b00 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:26.702041 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-62bf2d61-a24b-46a4-b70f-b082ed0a1b00 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:26.703245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-62bf2d61-a24b-46a4-b70f-b082ed0a1b00 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:26.706106 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-62bf2d61-a24b-46a4-b70f-b082ed0a1b00 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:26.707232 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-62bf2d61-a24b-46a4-b70f-b082ed0a1b00 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:26.867118 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-62bf2d61-a24b-46a4-b70f-b082ed0a1b00 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:26.885213 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-62bf2d61-a24b-46a4-b70f-b082ed0a1b00 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1294 microversion: 2.1 time: 0.211686 Jul 12 17:26:26.886986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-95f8fa9c-3f5b-4777-9239-70c98ac46066 req-07c80e9c-6390-4454-9364-47b8d0617b1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc4b5fa1-33f6-4da9-9411-e89b13939d30", "tag": "3616dee8-6bc4-4fb6-b034-e3ea6a8c7adc"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:26:26.887941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 33/89] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:26 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1294 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:26.931347 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-95f8fa9c-3f5b-4777-9239-70c98ac46066 req-07c80e9c-6390-4454-9364-47b8d0617b1f service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:26.931980 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-95f8fa9c-3f5b-4777-9239-70c98ac46066 req-07c80e9c-6390-4454-9364-47b8d0617b1f service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:26.971455 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-95f8fa9c-3f5b-4777-9239-70c98ac46066 req-07c80e9c-6390-4454-9364-47b8d0617b1f service nova] Creating event network-changed:3616dee8-6bc4-4fb6-b034-e3ea6a8c7adc for instance cc4b5fa1-33f6-4da9-9411-e89b13939d30 on hv-cinder-84932 Jul 12 17:26:26.971962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-95f8fa9c-3f5b-4777-9239-70c98ac46066 req-07c80e9c-6390-4454-9364-47b8d0617b1f service nova] Acquired lock "compute-rpcapi-router" {{(pid=117938) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 17:26:26.973091 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-056959a5-f615-4a8b-8a8a-089d7622f243 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:26.973531 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-056959a5-f615-4a8b-8a8a-089d7622f243 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:26.974334 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-056959a5-f615-4a8b-8a8a-089d7622f243 None None] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:26.975381 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-056959a5-f615-4a8b-8a8a-089d7622f243 None None] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:27.010343 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.compute.rpcapi [None req-056959a5-f615-4a8b-8a8a-089d7622f243 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 17:26:27.011258 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-056959a5-f615-4a8b-8a8a-089d7622f243 None None] Releasing lock "compute-rpcapi-router" {{(pid=117938) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 17:26:27.039122 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-056959a5-f615-4a8b-8a8a-089d7622f243 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160484 Jul 12 17:26:27.042878 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 57/90] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:26:27.213674 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=20 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:26:27.235743 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-94c47bb1-b504-4694-a33b-e8f4bce8d104 req-498845f9-ba43-4e5e-83c3-79566818b932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec1a3e3c-1467-458b-ace6-0ff381218e4a", "tag": "7fe73886-acc0-410d-b06c-1db1396a9c76"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:26:27.258539 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-94c47bb1-b504-4694-a33b-e8f4bce8d104 req-498845f9-ba43-4e5e-83c3-79566818b932 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:27.261660 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-94c47bb1-b504-4694-a33b-e8f4bce8d104 req-498845f9-ba43-4e5e-83c3-79566818b932 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:27.288256 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-94c47bb1-b504-4694-a33b-e8f4bce8d104 req-498845f9-ba43-4e5e-83c3-79566818b932 service nova] Creating event network-changed:7fe73886-acc0-410d-b06c-1db1396a9c76 for instance ec1a3e3c-1467-458b-ace6-0ff381218e4a on hv-cinder-84932 Jul 12 17:26:27.299188 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-94c47bb1-b504-4694-a33b-e8f4bce8d104 req-498845f9-ba43-4e5e-83c3-79566818b932 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222383 Jul 12 17:26:27.303376 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 34/91] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:26:27.333044 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-607de36b-fb6f-4668-8cbb-70bf1c85599e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:27.333809 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-607de36b-fb6f-4668-8cbb-70bf1c85599e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:27.350417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-607de36b-fb6f-4668-8cbb-70bf1c85599e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:27.350890 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-607de36b-fb6f-4668-8cbb-70bf1c85599e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:27.351659 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-607de36b-fb6f-4668-8cbb-70bf1c85599e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:27.352093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-607de36b-fb6f-4668-8cbb-70bf1c85599e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:27.370873 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6ffcb91c-cd4b-4ccf-b6af-4c74731c8921 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:27.371577 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6ffcb91c-cd4b-4ccf-b6af-4c74731c8921 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:27.393591 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6ffcb91c-cd4b-4ccf-b6af-4c74731c8921 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:27.398064 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6ffcb91c-cd4b-4ccf-b6af-4c74731c8921 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:27.399195 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6ffcb91c-cd4b-4ccf-b6af-4c74731c8921 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:27.401481 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6ffcb91c-cd4b-4ccf-b6af-4c74731c8921 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:27.940742 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6ffcb91c-cd4b-4ccf-b6af-4c74731c8921 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:27.948591 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6ffcb91c-cd4b-4ccf-b6af-4c74731c8921 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.582247 Jul 12 17:26:27.949467 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 35/92] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:27 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:26:27.954229 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-be1477e0-c072-4c13-a731-026a9de4c470 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:27.954953 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-be1477e0-c072-4c13-a731-026a9de4c470 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:27.959356 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-607de36b-fb6f-4668-8cbb-70bf1c85599e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:27.968958 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-607de36b-fb6f-4668-8cbb-70bf1c85599e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.640276 Jul 12 17:26:27.970503 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 58/93] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:27 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:27.979266 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-be1477e0-c072-4c13-a731-026a9de4c470 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:27.979706 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-be1477e0-c072-4c13-a731-026a9de4c470 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:27.980765 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-be1477e0-c072-4c13-a731-026a9de4c470 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:27.981437 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-be1477e0-c072-4c13-a731-026a9de4c470 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:28.061454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-be1477e0-c072-4c13-a731-026a9de4c470 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:28.075710 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-be1477e0-c072-4c13-a731-026a9de4c470 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1294 microversion: 2.1 time: 0.124660 Jul 12 17:26:28.076990 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 36/94] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:27 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1294 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:28.966583 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-68ddc3b3-a993-4a19-99b3-e9c079ffe9d2 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:28.967775 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-68ddc3b3-a993-4a19-99b3-e9c079ffe9d2 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:28.971454 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=18 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:26:28.980692 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68ddc3b3-a993-4a19-99b3-e9c079ffe9d2 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:28.982505 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68ddc3b3-a993-4a19-99b3-e9c079ffe9d2 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:28.988088 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-665d21f4-d5fb-4b7e-b3a3-2abb7f8c5b88 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:28.988775 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-665d21f4-d5fb-4b7e-b3a3-2abb7f8c5b88 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:28.996670 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68ddc3b3-a993-4a19-99b3-e9c079ffe9d2 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:28.998791 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68ddc3b3-a993-4a19-99b3-e9c079ffe9d2 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:29.002764 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=8 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:26:29.012861 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-665d21f4-d5fb-4b7e-b3a3-2abb7f8c5b88 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:29.013641 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-665d21f4-d5fb-4b7e-b3a3-2abb7f8c5b88 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:29.015578 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-665d21f4-d5fb-4b7e-b3a3-2abb7f8c5b88 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:29.017619 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-665d21f4-d5fb-4b7e-b3a3-2abb7f8c5b88 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:29.083778 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:26:29.708920 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-665d21f4-d5fb-4b7e-b3a3-2abb7f8c5b88 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:29.721995 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-665d21f4-d5fb-4b7e-b3a3-2abb7f8c5b88 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.735533 Jul 12 17:26:29.723957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 37/95] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:28 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:26:29.744023 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-68ddc3b3-a993-4a19-99b3-e9c079ffe9d2 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:29.758403 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b97de225-bf6f-4e9b-9907-987d6f747587 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:29.761012 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-68ddc3b3-a993-4a19-99b3-e9c079ffe9d2 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.798851 Jul 12 17:26:29.761919 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b97de225-bf6f-4e9b-9907-987d6f747587 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:29.764870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 59/96] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:28 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:29.773152 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b97de225-bf6f-4e9b-9907-987d6f747587 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:29.773909 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b97de225-bf6f-4e9b-9907-987d6f747587 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:29.775645 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b97de225-bf6f-4e9b-9907-987d6f747587 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:29.776088 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b97de225-bf6f-4e9b-9907-987d6f747587 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:29.922868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b97de225-bf6f-4e9b-9907-987d6f747587 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:29.937184 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b97de225-bf6f-4e9b-9907-987d6f747587 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1300 microversion: 2.1 time: 0.211297 Jul 12 17:26:29.938921 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 38/97] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:29 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1300 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:30.738554 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4a88bf93-92a9-4691-83b0-eb478523bc35 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:30.739966 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4a88bf93-92a9-4691-83b0-eb478523bc35 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:30.748769 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:26:30.752407 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a88bf93-92a9-4691-83b0-eb478523bc35 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:30.753085 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a88bf93-92a9-4691-83b0-eb478523bc35 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:30.754906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a88bf93-92a9-4691-83b0-eb478523bc35 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:30.755737 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a88bf93-92a9-4691-83b0-eb478523bc35 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:30.779800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c8acfb8d-57d5-4ae3-b629-38cde289f783 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:30.780430 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c8acfb8d-57d5-4ae3-b629-38cde289f783 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:30.810077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c8acfb8d-57d5-4ae3-b629-38cde289f783 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:30.810623 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c8acfb8d-57d5-4ae3-b629-38cde289f783 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:30.826642 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c8acfb8d-57d5-4ae3-b629-38cde289f783 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:30.827627 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c8acfb8d-57d5-4ae3-b629-38cde289f783 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:31.020144 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4a88bf93-92a9-4691-83b0-eb478523bc35 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:31.037950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4a88bf93-92a9-4691-83b0-eb478523bc35 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.301974 Jul 12 17:26:31.038760 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 60/98] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:30 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:31.048751 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-758515e0-b5f4-4c13-b53d-e16e88749c9e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:31.050857 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-758515e0-b5f4-4c13-b53d-e16e88749c9e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:31.072392 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-758515e0-b5f4-4c13-b53d-e16e88749c9e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:31.075063 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-758515e0-b5f4-4c13-b53d-e16e88749c9e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:31.077533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-758515e0-b5f4-4c13-b53d-e16e88749c9e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:31.078665 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-758515e0-b5f4-4c13-b53d-e16e88749c9e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:31.085257 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c8acfb8d-57d5-4ae3-b629-38cde289f783 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:31.097450 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c8acfb8d-57d5-4ae3-b629-38cde289f783 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.322286 Jul 12 17:26:31.107432 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 39/99] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:30 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:31.358158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-758515e0-b5f4-4c13-b53d-e16e88749c9e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:31.379943 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-758515e0-b5f4-4c13-b53d-e16e88749c9e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.338481 Jul 12 17:26:31.380717 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 61/100] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:31 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:32.055256 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ad4e181c-911a-482b-b8fa-6f0335fccf7b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:32.055859 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ad4e181c-911a-482b-b8fa-6f0335fccf7b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:32.057712 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:26:32.075046 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ad4e181c-911a-482b-b8fa-6f0335fccf7b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:32.076086 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ad4e181c-911a-482b-b8fa-6f0335fccf7b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:32.077098 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ad4e181c-911a-482b-b8fa-6f0335fccf7b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:32.078182 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ad4e181c-911a-482b-b8fa-6f0335fccf7b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:32.123167 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c6ae6731-8ffc-4e62-b13a-2d7b5576be1a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:32.124389 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c6ae6731-8ffc-4e62-b13a-2d7b5576be1a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:32.145622 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c6ae6731-8ffc-4e62-b13a-2d7b5576be1a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:32.147403 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c6ae6731-8ffc-4e62-b13a-2d7b5576be1a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:32.149395 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c6ae6731-8ffc-4e62-b13a-2d7b5576be1a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:32.150267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c6ae6731-8ffc-4e62-b13a-2d7b5576be1a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:32.461207 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ad4e181c-911a-482b-b8fa-6f0335fccf7b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:32.473924 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ad4e181c-911a-482b-b8fa-6f0335fccf7b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.422109 Jul 12 17:26:32.476016 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 40/101] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:32 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:32.486326 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6454dc09-21ca-4663-88a9-8bbd4d17ed3e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:32.488481 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6454dc09-21ca-4663-88a9-8bbd4d17ed3e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:32.502987 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6454dc09-21ca-4663-88a9-8bbd4d17ed3e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:32.504005 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6454dc09-21ca-4663-88a9-8bbd4d17ed3e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:32.505454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6454dc09-21ca-4663-88a9-8bbd4d17ed3e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:32.506331 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6454dc09-21ca-4663-88a9-8bbd4d17ed3e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:32.533034 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c6ae6731-8ffc-4e62-b13a-2d7b5576be1a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:32.543647 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c6ae6731-8ffc-4e62-b13a-2d7b5576be1a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.425541 Jul 12 17:26:32.554614 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 62/102] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:32 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:32.808692 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6454dc09-21ca-4663-88a9-8bbd4d17ed3e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:32.819919 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6454dc09-21ca-4663-88a9-8bbd4d17ed3e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.340792 Jul 12 17:26:32.821431 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 41/103] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:32 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:33.492440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1f2e9d18-3e98-4f4c-bb1e-ed2fadcdc3bb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:33.493963 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1f2e9d18-3e98-4f4c-bb1e-ed2fadcdc3bb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:33.503290 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1f2e9d18-3e98-4f4c-bb1e-ed2fadcdc3bb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:33.506675 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1f2e9d18-3e98-4f4c-bb1e-ed2fadcdc3bb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:33.507644 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1f2e9d18-3e98-4f4c-bb1e-ed2fadcdc3bb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:33.508785 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1f2e9d18-3e98-4f4c-bb1e-ed2fadcdc3bb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:33.566130 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ca037924-3cb4-4800-a8b2-df11e384b942 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:33.569143 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ca037924-3cb4-4800-a8b2-df11e384b942 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:33.589134 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ca037924-3cb4-4800-a8b2-df11e384b942 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:33.589869 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ca037924-3cb4-4800-a8b2-df11e384b942 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:33.590863 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ca037924-3cb4-4800-a8b2-df11e384b942 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:33.591506 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ca037924-3cb4-4800-a8b2-df11e384b942 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:33.863226 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1f2e9d18-3e98-4f4c-bb1e-ed2fadcdc3bb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:33.877173 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1f2e9d18-3e98-4f4c-bb1e-ed2fadcdc3bb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.389450 Jul 12 17:26:33.878779 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 63/104] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:33 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:33.885263 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a1c9fc77-c1c9-4d3c-acb0-d46ee95c54d0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:33.886278 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a1c9fc77-c1c9-4d3c-acb0-d46ee95c54d0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:33.895202 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a1c9fc77-c1c9-4d3c-acb0-d46ee95c54d0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:33.895958 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a1c9fc77-c1c9-4d3c-acb0-d46ee95c54d0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:33.900428 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ca037924-3cb4-4800-a8b2-df11e384b942 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:33.911712 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a1c9fc77-c1c9-4d3c-acb0-d46ee95c54d0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:33.913279 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a1c9fc77-c1c9-4d3c-acb0-d46ee95c54d0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:33.915145 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ca037924-3cb4-4800-a8b2-df11e384b942 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.358456 Jul 12 17:26:33.928519 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 42/105] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:33 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:33.936723 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-30085155-8e1c-4d85-9060-b7c9a53e1195 req-46f869e2-2bce-491f-a309-d9627edcd4ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58fa8d33-4b3c-45f2-8d46-38f4f5932cf2", "tag": "b8875684-ac70-4178-b58c-59ccedcabb36"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:26:33.958064 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-30085155-8e1c-4d85-9060-b7c9a53e1195 req-46f869e2-2bce-491f-a309-d9627edcd4ee service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:33.958430 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-30085155-8e1c-4d85-9060-b7c9a53e1195 req-46f869e2-2bce-491f-a309-d9627edcd4ee service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:33.994317 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-30085155-8e1c-4d85-9060-b7c9a53e1195 req-46f869e2-2bce-491f-a309-d9627edcd4ee service nova] Creating event network-changed:b8875684-ac70-4178-b58c-59ccedcabb36 for instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 on hv-cinder-84932 Jul 12 17:26:34.014624 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-30085155-8e1c-4d85-9060-b7c9a53e1195 req-46f869e2-2bce-491f-a309-d9627edcd4ee service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084270 Jul 12 17:26:34.019447 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 43/106] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:26:34.190317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a1c9fc77-c1c9-4d3c-acb0-d46ee95c54d0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:34.201302 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a1c9fc77-c1c9-4d3c-acb0-d46ee95c54d0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.321132 Jul 12 17:26:34.202033 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 64/107] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:33 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:34.901750 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-736bb1ee-e2b1-46e7-90bf-37c596e84937 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:34.901750 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-736bb1ee-e2b1-46e7-90bf-37c596e84937 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:34.907221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-736bb1ee-e2b1-46e7-90bf-37c596e84937 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:34.907985 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-736bb1ee-e2b1-46e7-90bf-37c596e84937 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:34.908944 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-736bb1ee-e2b1-46e7-90bf-37c596e84937 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:34.909652 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-736bb1ee-e2b1-46e7-90bf-37c596e84937 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:34.933612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-58c68a39-780d-4b5c-89ed-82835b383716 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:34.934207 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-58c68a39-780d-4b5c-89ed-82835b383716 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:34.946038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-58c68a39-780d-4b5c-89ed-82835b383716 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:34.946845 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-58c68a39-780d-4b5c-89ed-82835b383716 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:34.948119 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-58c68a39-780d-4b5c-89ed-82835b383716 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:34.948587 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-58c68a39-780d-4b5c-89ed-82835b383716 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:35.139482 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-58c68a39-780d-4b5c-89ed-82835b383716 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:35.148507 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-58c68a39-780d-4b5c-89ed-82835b383716 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.218475 Jul 12 17:26:35.149832 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 65/108] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:34 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:26:35.158853 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-736bb1ee-e2b1-46e7-90bf-37c596e84937 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:35.167793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-736bb1ee-e2b1-46e7-90bf-37c596e84937 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.276908 Jul 12 17:26:35.168682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 44/109] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:34 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:35.219712 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c827eedf-c9c7-4448-b20c-c16b2f6048e4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:35.221057 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c827eedf-c9c7-4448-b20c-c16b2f6048e4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:35.232051 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c827eedf-c9c7-4448-b20c-c16b2f6048e4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:35.232954 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c827eedf-c9c7-4448-b20c-c16b2f6048e4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:35.234841 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c827eedf-c9c7-4448-b20c-c16b2f6048e4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:35.235453 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c827eedf-c9c7-4448-b20c-c16b2f6048e4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:35.399149 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c827eedf-c9c7-4448-b20c-c16b2f6048e4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:35.406591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c827eedf-c9c7-4448-b20c-c16b2f6048e4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.192774 Jul 12 17:26:35.407152 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 66/110] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:35 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:36.029155 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-cdb0c0d0-08d6-4735-aadd-863d24b7e498 req-baaf96b3-7064-41c5-987a-b8599aebb90a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4d99e1a-efd3-4510-ac75-1c21c7937044", "name": "network-vif-plugged", "status": "completed", "tag": "139b5be4-a836-4dac-8cf5-8f90d7599330"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:26:36.036939 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-cdb0c0d0-08d6-4735-aadd-863d24b7e498 req-baaf96b3-7064-41c5-987a-b8599aebb90a service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:36.037975 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-cdb0c0d0-08d6-4735-aadd-863d24b7e498 req-baaf96b3-7064-41c5-987a-b8599aebb90a service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:36.048273 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-cdb0c0d0-08d6-4735-aadd-863d24b7e498 req-baaf96b3-7064-41c5-987a-b8599aebb90a service nova] Creating event network-vif-plugged:139b5be4-a836-4dac-8cf5-8f90d7599330 for instance f4d99e1a-efd3-4510-ac75-1c21c7937044 on hv-cinder-84932 Jul 12 17:26:36.052934 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-cdb0c0d0-08d6-4735-aadd-863d24b7e498 req-baaf96b3-7064-41c5-987a-b8599aebb90a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083287 Jul 12 17:26:36.053499 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 45/111] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:26:36.162845 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b8fb8319-98c8-4745-9de6-a482f3916535 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:36.163503 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b8fb8319-98c8-4745-9de6-a482f3916535 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:36.169372 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b8fb8319-98c8-4745-9de6-a482f3916535 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:36.169857 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b8fb8319-98c8-4745-9de6-a482f3916535 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:36.170611 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b8fb8319-98c8-4745-9de6-a482f3916535 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:36.171044 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b8fb8319-98c8-4745-9de6-a482f3916535 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:36.185496 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-21e7c9ec-5f88-4e99-b114-520bfae54291 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:36.186226 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-21e7c9ec-5f88-4e99-b114-520bfae54291 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:36.192435 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-21e7c9ec-5f88-4e99-b114-520bfae54291 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:36.192882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-21e7c9ec-5f88-4e99-b114-520bfae54291 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:36.194172 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-21e7c9ec-5f88-4e99-b114-520bfae54291 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:36.194608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-21e7c9ec-5f88-4e99-b114-520bfae54291 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:36.368722 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b8fb8319-98c8-4745-9de6-a482f3916535 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:36.371678 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-21e7c9ec-5f88-4e99-b114-520bfae54291 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:36.376230 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b8fb8319-98c8-4745-9de6-a482f3916535 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.217182 Jul 12 17:26:36.376797 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 67/112] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:36 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:36.379232 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-21e7c9ec-5f88-4e99-b114-520bfae54291 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.198607 Jul 12 17:26:36.379835 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 46/113] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:36 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:26:36.423945 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b320e56c-b24f-4fe2-825d-30c2dc6f08f4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:36.424565 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b320e56c-b24f-4fe2-825d-30c2dc6f08f4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:36.430707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b320e56c-b24f-4fe2-825d-30c2dc6f08f4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:36.431164 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b320e56c-b24f-4fe2-825d-30c2dc6f08f4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:36.431933 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b320e56c-b24f-4fe2-825d-30c2dc6f08f4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:36.432369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b320e56c-b24f-4fe2-825d-30c2dc6f08f4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:36.567884 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b320e56c-b24f-4fe2-825d-30c2dc6f08f4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:36.576426 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b320e56c-b24f-4fe2-825d-30c2dc6f08f4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.156228 Jul 12 17:26:36.577049 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 68/114] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:36 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:37.404119 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b10555d1-0998-4b7b-a0c8-d9fa41be11c1 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:37.408010 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-54ca5266-cd10-4df9-9c97-0bf37aaf2d96 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:37.409431 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-54ca5266-cd10-4df9-9c97-0bf37aaf2d96 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:37.410161 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b10555d1-0998-4b7b-a0c8-d9fa41be11c1 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:37.419031 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:26:37.423616 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b10555d1-0998-4b7b-a0c8-d9fa41be11c1 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:37.424079 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b10555d1-0998-4b7b-a0c8-d9fa41be11c1 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:37.426611 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-54ca5266-cd10-4df9-9c97-0bf37aaf2d96 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:37.427121 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-54ca5266-cd10-4df9-9c97-0bf37aaf2d96 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:37.428484 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-54ca5266-cd10-4df9-9c97-0bf37aaf2d96 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:37.429055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b10555d1-0998-4b7b-a0c8-d9fa41be11c1 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:37.429567 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b10555d1-0998-4b7b-a0c8-d9fa41be11c1 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:37.429785 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-54ca5266-cd10-4df9-9c97-0bf37aaf2d96 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:37.850122 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-54ca5266-cd10-4df9-9c97-0bf37aaf2d96 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:37.861907 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-54ca5266-cd10-4df9-9c97-0bf37aaf2d96 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.468994 Jul 12 17:26:37.874141 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b10555d1-0998-4b7b-a0c8-d9fa41be11c1 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:37.876107 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 69/115] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:37 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:37.881379 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b10555d1-0998-4b7b-a0c8-d9fa41be11c1 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.487764 Jul 12 17:26:37.882389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 47/116] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:37 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:37.893051 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d0309511-280b-46ae-9b72-4bf3d7c3ba28 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:37.894947 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d0309511-280b-46ae-9b72-4bf3d7c3ba28 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:37.928400 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0309511-280b-46ae-9b72-4bf3d7c3ba28 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:37.929025 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0309511-280b-46ae-9b72-4bf3d7c3ba28 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:37.930537 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0309511-280b-46ae-9b72-4bf3d7c3ba28 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:37.932712 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0309511-280b-46ae-9b72-4bf3d7c3ba28 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:38.131650 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d0309511-280b-46ae-9b72-4bf3d7c3ba28 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:38.140982 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d0309511-280b-46ae-9b72-4bf3d7c3ba28 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.263695 Jul 12 17:26:38.141568 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 70/117] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:37 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:38.883589 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-790fde6e-dd62-49d8-9326-db600a679bb8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:38.884527 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-790fde6e-dd62-49d8-9326-db600a679bb8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:38.890439 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-790fde6e-dd62-49d8-9326-db600a679bb8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:38.891135 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-790fde6e-dd62-49d8-9326-db600a679bb8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:38.891970 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-790fde6e-dd62-49d8-9326-db600a679bb8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:38.892599 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-790fde6e-dd62-49d8-9326-db600a679bb8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:38.898630 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6f1c09eb-3f23-46fd-a7c6-034380fd0c3d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:38.899367 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6f1c09eb-3f23-46fd-a7c6-034380fd0c3d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:38.905590 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6f1c09eb-3f23-46fd-a7c6-034380fd0c3d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:38.910621 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6f1c09eb-3f23-46fd-a7c6-034380fd0c3d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:38.911439 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6f1c09eb-3f23-46fd-a7c6-034380fd0c3d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:38.911909 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6f1c09eb-3f23-46fd-a7c6-034380fd0c3d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:39.125516 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-790fde6e-dd62-49d8-9326-db600a679bb8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:39.137979 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-790fde6e-dd62-49d8-9326-db600a679bb8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.258071 Jul 12 17:26:39.139199 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 48/118] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:38 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:39.166032 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6f1c09eb-3f23-46fd-a7c6-034380fd0c3d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:39.167340 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ba867fa8-42e8-43f4-9bcd-8789d972c48e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:39.169216 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ba867fa8-42e8-43f4-9bcd-8789d972c48e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:39.173595 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6f1c09eb-3f23-46fd-a7c6-034380fd0c3d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.279339 Jul 12 17:26:39.174819 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 71/119] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:38 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:26:39.179352 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ba867fa8-42e8-43f4-9bcd-8789d972c48e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:39.180077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ba867fa8-42e8-43f4-9bcd-8789d972c48e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:39.181868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ba867fa8-42e8-43f4-9bcd-8789d972c48e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:39.182796 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ba867fa8-42e8-43f4-9bcd-8789d972c48e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:39.411895 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ba867fa8-42e8-43f4-9bcd-8789d972c48e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:39.419495 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ba867fa8-42e8-43f4-9bcd-8789d972c48e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.263035 Jul 12 17:26:39.420062 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 49/120] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:39 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:40.154681 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c45b46f9-f226-4e28-b292-13c6f36487c6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:40.155292 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c45b46f9-f226-4e28-b292-13c6f36487c6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:40.161380 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c45b46f9-f226-4e28-b292-13c6f36487c6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:40.162389 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c45b46f9-f226-4e28-b292-13c6f36487c6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:40.163163 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c45b46f9-f226-4e28-b292-13c6f36487c6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:40.163594 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c45b46f9-f226-4e28-b292-13c6f36487c6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:40.192871 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-eb4ede9a-71cf-4aa7-8088-d979b35a57a7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:40.193635 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-eb4ede9a-71cf-4aa7-8088-d979b35a57a7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:40.202020 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eb4ede9a-71cf-4aa7-8088-d979b35a57a7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:40.202860 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eb4ede9a-71cf-4aa7-8088-d979b35a57a7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:40.203894 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eb4ede9a-71cf-4aa7-8088-d979b35a57a7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:40.204604 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eb4ede9a-71cf-4aa7-8088-d979b35a57a7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:40.409004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-eb4ede9a-71cf-4aa7-8088-d979b35a57a7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:40.413365 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c45b46f9-f226-4e28-b292-13c6f36487c6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:40.419995 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-eb4ede9a-71cf-4aa7-8088-d979b35a57a7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.231455 Jul 12 17:26:40.422091 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 50/121] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:40 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:26:40.433371 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c45b46f9-f226-4e28-b292-13c6f36487c6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.282360 Jul 12 17:26:40.434198 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 72/122] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:40 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:40.442712 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-678ca781-b29e-4327-8389-fe199633cb9e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:40.442712 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-678ca781-b29e-4327-8389-fe199633cb9e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:40.445412 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-678ca781-b29e-4327-8389-fe199633cb9e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:40.445913 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-678ca781-b29e-4327-8389-fe199633cb9e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:40.447040 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-678ca781-b29e-4327-8389-fe199633cb9e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:40.447361 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-678ca781-b29e-4327-8389-fe199633cb9e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:40.588122 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-678ca781-b29e-4327-8389-fe199633cb9e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:40.595355 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-678ca781-b29e-4327-8389-fe199633cb9e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.162484 Jul 12 17:26:40.595920 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 51/123] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:40 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:41.438864 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b320d0bf-0ce3-4942-92c2-8710dfad87e1 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:41.439484 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b320d0bf-0ce3-4942-92c2-8710dfad87e1 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:41.447914 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b320d0bf-0ce3-4942-92c2-8710dfad87e1 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:41.448360 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b320d0bf-0ce3-4942-92c2-8710dfad87e1 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:41.449156 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b320d0bf-0ce3-4942-92c2-8710dfad87e1 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:41.449586 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b320d0bf-0ce3-4942-92c2-8710dfad87e1 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:41.450593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8dd7be63-0ac9-43b3-99b0-810ff0db614d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:41.451219 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8dd7be63-0ac9-43b3-99b0-810ff0db614d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:41.455075 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:26:41.462351 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8dd7be63-0ac9-43b3-99b0-810ff0db614d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:41.462878 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8dd7be63-0ac9-43b3-99b0-810ff0db614d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:41.463658 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8dd7be63-0ac9-43b3-99b0-810ff0db614d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:41.464092 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8dd7be63-0ac9-43b3-99b0-810ff0db614d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:41.663273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b320d0bf-0ce3-4942-92c2-8710dfad87e1 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:41.670549 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b320d0bf-0ce3-4942-92c2-8710dfad87e1 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.235457 Jul 12 17:26:41.671120 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 73/124] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:41 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:41.675711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5fc7af26-6409-43ad-87e2-8b0f4f63ced5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:41.676244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5fc7af26-6409-43ad-87e2-8b0f4f63ced5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:41.681964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5fc7af26-6409-43ad-87e2-8b0f4f63ced5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:41.682412 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5fc7af26-6409-43ad-87e2-8b0f4f63ced5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:41.683171 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5fc7af26-6409-43ad-87e2-8b0f4f63ced5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:41.683596 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5fc7af26-6409-43ad-87e2-8b0f4f63ced5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:41.691931 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8dd7be63-0ac9-43b3-99b0-810ff0db614d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:41.700016 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8dd7be63-0ac9-43b3-99b0-810ff0db614d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.253614 Jul 12 17:26:41.700588 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 52/125] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:41 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:26:41.821232 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5fc7af26-6409-43ad-87e2-8b0f4f63ced5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:41.831647 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5fc7af26-6409-43ad-87e2-8b0f4f63ced5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.159228 Jul 12 17:26:41.841068 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 74/126] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:41 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:42.688270 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d71a50cb-f021-4923-8b19-8dfd8d836d21 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:42.688878 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d71a50cb-f021-4923-8b19-8dfd8d836d21 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:42.694825 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d71a50cb-f021-4923-8b19-8dfd8d836d21 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:42.695266 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d71a50cb-f021-4923-8b19-8dfd8d836d21 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:42.696020 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d71a50cb-f021-4923-8b19-8dfd8d836d21 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:42.696705 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d71a50cb-f021-4923-8b19-8dfd8d836d21 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:42.717020 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-61c34296-9908-4f39-a93b-6054ad9a77ce tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:42.718256 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-61c34296-9908-4f39-a93b-6054ad9a77ce tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:42.725403 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-61c34296-9908-4f39-a93b-6054ad9a77ce tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:42.725888 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-61c34296-9908-4f39-a93b-6054ad9a77ce tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:42.726873 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-61c34296-9908-4f39-a93b-6054ad9a77ce tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:42.727504 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-61c34296-9908-4f39-a93b-6054ad9a77ce tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:42.903718 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d71a50cb-f021-4923-8b19-8dfd8d836d21 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:42.907902 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-61c34296-9908-4f39-a93b-6054ad9a77ce tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:42.911718 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d71a50cb-f021-4923-8b19-8dfd8d836d21 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.228180 Jul 12 17:26:42.912532 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 53/127] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:42 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:42.915799 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-61c34296-9908-4f39-a93b-6054ad9a77ce tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.202632 Jul 12 17:26:42.916609 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 75/128] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:42 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:26:42.917129 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8777b227-97ea-44ce-b7d3-d4d7b8e006d8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:42.917924 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8777b227-97ea-44ce-b7d3-d4d7b8e006d8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:42.923741 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8777b227-97ea-44ce-b7d3-d4d7b8e006d8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:42.924271 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8777b227-97ea-44ce-b7d3-d4d7b8e006d8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:42.925170 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8777b227-97ea-44ce-b7d3-d4d7b8e006d8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:42.925608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8777b227-97ea-44ce-b7d3-d4d7b8e006d8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:43.056044 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8777b227-97ea-44ce-b7d3-d4d7b8e006d8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:43.064080 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8777b227-97ea-44ce-b7d3-d4d7b8e006d8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.150341 Jul 12 17:26:43.064705 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 54/129] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:42 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:43.929510 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7a0d7343-5e1d-411d-8100-87aaa81fc98d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:43.930260 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7a0d7343-5e1d-411d-8100-87aaa81fc98d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:43.936429 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f939b3bc-acae-4b76-9065-430caddd526d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:43.936901 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7a0d7343-5e1d-411d-8100-87aaa81fc98d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:43.937271 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7a0d7343-5e1d-411d-8100-87aaa81fc98d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:43.938076 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7a0d7343-5e1d-411d-8100-87aaa81fc98d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:43.938216 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f939b3bc-acae-4b76-9065-430caddd526d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:43.938511 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7a0d7343-5e1d-411d-8100-87aaa81fc98d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:43.945190 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f939b3bc-acae-4b76-9065-430caddd526d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:43.946068 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f939b3bc-acae-4b76-9065-430caddd526d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:43.947348 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f939b3bc-acae-4b76-9065-430caddd526d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:43.947775 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f939b3bc-acae-4b76-9065-430caddd526d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:43.969483 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:26:44.137051 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7a0d7343-5e1d-411d-8100-87aaa81fc98d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:44.141729 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f939b3bc-acae-4b76-9065-430caddd526d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:44.144806 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7a0d7343-5e1d-411d-8100-87aaa81fc98d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.220164 Jul 12 17:26:44.145898 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 76/130] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:43 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:44.151329 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f939b3bc-acae-4b76-9065-430caddd526d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.218942 Jul 12 17:26:44.160582 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-61966ba1-0578-4fbe-968a-f61114744bba tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:44.160582 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-61966ba1-0578-4fbe-968a-f61114744bba tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:44.160582 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-61966ba1-0578-4fbe-968a-f61114744bba tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:44.160582 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-61966ba1-0578-4fbe-968a-f61114744bba tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:44.161023 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-61966ba1-0578-4fbe-968a-f61114744bba tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:44.161023 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-61966ba1-0578-4fbe-968a-f61114744bba tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:44.162724 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 55/131] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:43 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:26:44.295424 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-61966ba1-0578-4fbe-968a-f61114744bba tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:44.302929 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-61966ba1-0578-4fbe-968a-f61114744bba tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.155200 Jul 12 17:26:44.303502 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 77/132] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:44 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:45.161637 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2bcb4deb-f25a-4661-8b3b-36d036b219e8 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:45.162369 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2bcb4deb-f25a-4661-8b3b-36d036b219e8 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:45.168475 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f0bff8e7-f7cb-4a47-ab59-f5e729442986 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:45.169108 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f0bff8e7-f7cb-4a47-ab59-f5e729442986 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:45.169306 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2bcb4deb-f25a-4661-8b3b-36d036b219e8 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:45.169784 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2bcb4deb-f25a-4661-8b3b-36d036b219e8 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:45.170551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2bcb4deb-f25a-4661-8b3b-36d036b219e8 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:45.170990 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2bcb4deb-f25a-4661-8b3b-36d036b219e8 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:45.175027 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f0bff8e7-f7cb-4a47-ab59-f5e729442986 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:45.175479 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f0bff8e7-f7cb-4a47-ab59-f5e729442986 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:45.176232 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f0bff8e7-f7cb-4a47-ab59-f5e729442986 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:45.176669 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f0bff8e7-f7cb-4a47-ab59-f5e729442986 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:45.360392 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2bcb4deb-f25a-4661-8b3b-36d036b219e8 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:45.363404 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f0bff8e7-f7cb-4a47-ab59-f5e729442986 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:45.368972 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2bcb4deb-f25a-4661-8b3b-36d036b219e8 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.210571 Jul 12 17:26:45.369560 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 56/133] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:45 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:45.371527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f0bff8e7-f7cb-4a47-ab59-f5e729442986 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.206668 Jul 12 17:26:45.373736 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 78/134] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:45 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:26:45.374057 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9620224f-9ce6-48a4-aa09-eceb4746807e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:45.374813 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9620224f-9ce6-48a4-aa09-eceb4746807e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:45.380571 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9620224f-9ce6-48a4-aa09-eceb4746807e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:45.381016 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9620224f-9ce6-48a4-aa09-eceb4746807e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:45.381803 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9620224f-9ce6-48a4-aa09-eceb4746807e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:45.382241 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9620224f-9ce6-48a4-aa09-eceb4746807e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:45.511684 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9620224f-9ce6-48a4-aa09-eceb4746807e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:45.518887 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9620224f-9ce6-48a4-aa09-eceb4746807e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.148350 Jul 12 17:26:45.519443 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 57/135] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:45 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:46.391502 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-18d5609c-7215-4a5f-b8e8-49987b0912c0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:46.392162 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8e654f27-80ae-4336-8878-6635a0c70afb tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:46.392558 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-18d5609c-7215-4a5f-b8e8-49987b0912c0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:46.392638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8e654f27-80ae-4336-8878-6635a0c70afb tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:46.398600 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-18d5609c-7215-4a5f-b8e8-49987b0912c0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:46.398799 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8e654f27-80ae-4336-8878-6635a0c70afb tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:46.399046 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-18d5609c-7215-4a5f-b8e8-49987b0912c0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:46.399148 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8e654f27-80ae-4336-8878-6635a0c70afb tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:46.399824 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-18d5609c-7215-4a5f-b8e8-49987b0912c0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:46.399933 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8e654f27-80ae-4336-8878-6635a0c70afb tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:46.400432 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-18d5609c-7215-4a5f-b8e8-49987b0912c0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:46.400594 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8e654f27-80ae-4336-8878-6635a0c70afb tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:46.588772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-18d5609c-7215-4a5f-b8e8-49987b0912c0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:46.595027 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8e654f27-80ae-4336-8878-6635a0c70afb tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:46.596245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-18d5609c-7215-4a5f-b8e8-49987b0912c0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.211564 Jul 12 17:26:46.596820 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 58/136] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:46 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:26:46.602021 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-42147124-eacd-4dbe-873c-25b3fbfb007a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:46.602633 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-42147124-eacd-4dbe-873c-25b3fbfb007a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:46.603385 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8e654f27-80ae-4336-8878-6635a0c70afb tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.221479 Jul 12 17:26:46.603952 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 79/137] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:46 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:46.608298 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-42147124-eacd-4dbe-873c-25b3fbfb007a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:46.608747 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-42147124-eacd-4dbe-873c-25b3fbfb007a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:46.610440 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-42147124-eacd-4dbe-873c-25b3fbfb007a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:46.610895 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-42147124-eacd-4dbe-873c-25b3fbfb007a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:46.922475 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-42147124-eacd-4dbe-873c-25b3fbfb007a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:46.930600 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-42147124-eacd-4dbe-873c-25b3fbfb007a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.332602 Jul 12 17:26:46.931166 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 59/138] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:46 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:47.612186 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ca01a08b-78ec-402a-9f0e-797e0aeb0fff tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:47.612936 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ca01a08b-78ec-402a-9f0e-797e0aeb0fff tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:47.619322 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ca01a08b-78ec-402a-9f0e-797e0aeb0fff tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:47.619779 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ca01a08b-78ec-402a-9f0e-797e0aeb0fff tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:47.620555 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ca01a08b-78ec-402a-9f0e-797e0aeb0fff tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:47.620715 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-406871b2-0d4b-4770-8103-38332a174a55 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:47.621183 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ca01a08b-78ec-402a-9f0e-797e0aeb0fff tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:47.622192 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-406871b2-0d4b-4770-8103-38332a174a55 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:47.628390 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-406871b2-0d4b-4770-8103-38332a174a55 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:47.628924 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-406871b2-0d4b-4770-8103-38332a174a55 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:47.630827 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-406871b2-0d4b-4770-8103-38332a174a55 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:47.631370 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-406871b2-0d4b-4770-8103-38332a174a55 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:47.843401 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ca01a08b-78ec-402a-9f0e-797e0aeb0fff tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:47.847006 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-406871b2-0d4b-4770-8103-38332a174a55 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:47.851544 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ca01a08b-78ec-402a-9f0e-797e0aeb0fff tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.243123 Jul 12 17:26:47.852369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 80/139] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:47 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:47.864142 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-406871b2-0d4b-4770-8103-38332a174a55 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.247841 Jul 12 17:26:47.864726 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 60/140] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:47 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:26:47.947445 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a0eb5d86-205d-4865-abfd-5ef3e190c713 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:47.948051 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a0eb5d86-205d-4865-abfd-5ef3e190c713 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:47.954014 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a0eb5d86-205d-4865-abfd-5ef3e190c713 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:47.954446 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a0eb5d86-205d-4865-abfd-5ef3e190c713 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:47.955191 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a0eb5d86-205d-4865-abfd-5ef3e190c713 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:47.955624 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a0eb5d86-205d-4865-abfd-5ef3e190c713 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:48.078976 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a0eb5d86-205d-4865-abfd-5ef3e190c713 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:48.086225 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a0eb5d86-205d-4865-abfd-5ef3e190c713 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.143487 Jul 12 17:26:48.087078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 81/141] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:47 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:48.868745 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0caa4b84-bd57-4da2-ac8d-280f77e11704 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:48.869269 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0caa4b84-bd57-4da2-ac8d-280f77e11704 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:48.875213 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0caa4b84-bd57-4da2-ac8d-280f77e11704 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:48.875742 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0caa4b84-bd57-4da2-ac8d-280f77e11704 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:48.876516 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0caa4b84-bd57-4da2-ac8d-280f77e11704 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:48.876948 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0caa4b84-bd57-4da2-ac8d-280f77e11704 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:48.880595 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f18f18f5-0e03-42da-873b-23fc0f953a81 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:48.881204 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f18f18f5-0e03-42da-873b-23fc0f953a81 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:48.887631 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f18f18f5-0e03-42da-873b-23fc0f953a81 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:48.888073 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f18f18f5-0e03-42da-873b-23fc0f953a81 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:48.888825 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f18f18f5-0e03-42da-873b-23fc0f953a81 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:48.889254 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f18f18f5-0e03-42da-873b-23fc0f953a81 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:49.070197 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0caa4b84-bd57-4da2-ac8d-280f77e11704 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:49.077941 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f18f18f5-0e03-42da-873b-23fc0f953a81 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:49.078203 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0caa4b84-bd57-4da2-ac8d-280f77e11704 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.213361 Jul 12 17:26:49.078779 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 61/142] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:48 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:49.085330 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f18f18f5-0e03-42da-873b-23fc0f953a81 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.208464 Jul 12 17:26:49.085918 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 82/143] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:48 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:26:49.103100 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-dc765749-c5c3-4c92-b384-d3930f336d53 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:49.103712 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-dc765749-c5c3-4c92-b384-d3930f336d53 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:49.109507 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dc765749-c5c3-4c92-b384-d3930f336d53 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:49.109993 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dc765749-c5c3-4c92-b384-d3930f336d53 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:49.110757 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dc765749-c5c3-4c92-b384-d3930f336d53 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:49.111191 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dc765749-c5c3-4c92-b384-d3930f336d53 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:49.235108 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-dc765749-c5c3-4c92-b384-d3930f336d53 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:49.243042 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-dc765749-c5c3-4c92-b384-d3930f336d53 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.143167 Jul 12 17:26:49.243605 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 62/144] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:49 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:50.094886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b41ab02e-5ac8-42c7-8710-168d03820534 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:50.095500 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b41ab02e-5ac8-42c7-8710-168d03820534 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:50.101489 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b41ab02e-5ac8-42c7-8710-168d03820534 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:50.102609 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b41ab02e-5ac8-42c7-8710-168d03820534 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:50.102739 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6ae952e3-18e8-4c52-85fd-8826eac391ff tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:50.103291 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6ae952e3-18e8-4c52-85fd-8826eac391ff tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:50.103428 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b41ab02e-5ac8-42c7-8710-168d03820534 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:50.103795 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b41ab02e-5ac8-42c7-8710-168d03820534 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:50.109112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6ae952e3-18e8-4c52-85fd-8826eac391ff tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:50.109548 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6ae952e3-18e8-4c52-85fd-8826eac391ff tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:50.110332 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6ae952e3-18e8-4c52-85fd-8826eac391ff tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:50.110758 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6ae952e3-18e8-4c52-85fd-8826eac391ff tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:50.292859 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b41ab02e-5ac8-42c7-8710-168d03820534 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:50.297090 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6ae952e3-18e8-4c52-85fd-8826eac391ff tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:50.300552 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b41ab02e-5ac8-42c7-8710-168d03820534 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.209382 Jul 12 17:26:50.301139 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 83/145] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:50 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:50.306129 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6ae952e3-18e8-4c52-85fd-8826eac391ff tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.207650 Jul 12 17:26:50.307601 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f04a9a48-428d-4230-b8bd-15ac16e95f32 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:50.308420 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f04a9a48-428d-4230-b8bd-15ac16e95f32 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:50.314757 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f04a9a48-428d-4230-b8bd-15ac16e95f32 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:50.315583 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f04a9a48-428d-4230-b8bd-15ac16e95f32 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:50.316363 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f04a9a48-428d-4230-b8bd-15ac16e95f32 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:50.316676 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 63/146] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:50 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:26:50.316907 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f04a9a48-428d-4230-b8bd-15ac16e95f32 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:50.444462 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f04a9a48-428d-4230-b8bd-15ac16e95f32 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:50.452488 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f04a9a48-428d-4230-b8bd-15ac16e95f32 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.150211 Jul 12 17:26:50.453045 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 84/147] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:50 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:51.316883 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b3efc151-fc64-4ea1-b0df-d5cf37db1e6b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:51.317489 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b3efc151-fc64-4ea1-b0df-d5cf37db1e6b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:51.324258 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-96c19366-ee20-48c2-a2c5-01dea0355694 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:51.324668 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b3efc151-fc64-4ea1-b0df-d5cf37db1e6b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:51.324868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b3efc151-fc64-4ea1-b0df-d5cf37db1e6b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:51.324975 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-96c19366-ee20-48c2-a2c5-01dea0355694 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:51.325619 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b3efc151-fc64-4ea1-b0df-d5cf37db1e6b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:51.326073 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b3efc151-fc64-4ea1-b0df-d5cf37db1e6b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:51.330822 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96c19366-ee20-48c2-a2c5-01dea0355694 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:51.331273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96c19366-ee20-48c2-a2c5-01dea0355694 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:51.332029 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96c19366-ee20-48c2-a2c5-01dea0355694 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:51.332462 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96c19366-ee20-48c2-a2c5-01dea0355694 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:51.515087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b3efc151-fc64-4ea1-b0df-d5cf37db1e6b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:51.522310 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-96c19366-ee20-48c2-a2c5-01dea0355694 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:51.522753 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b3efc151-fc64-4ea1-b0df-d5cf37db1e6b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.209623 Jul 12 17:26:51.523520 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 64/148] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:51 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:51.527794 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-14041de2-e694-42e8-af5c-aed1bd6cfe30 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:51.528406 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-14041de2-e694-42e8-af5c-aed1bd6cfe30 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:51.532432 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-96c19366-ee20-48c2-a2c5-01dea0355694 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.212836 Jul 12 17:26:51.533337 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 85/149] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:51 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:26:51.543958 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-14041de2-e694-42e8-af5c-aed1bd6cfe30 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:51.544460 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-14041de2-e694-42e8-af5c-aed1bd6cfe30 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:51.545258 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-14041de2-e694-42e8-af5c-aed1bd6cfe30 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:51.545706 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-14041de2-e694-42e8-af5c-aed1bd6cfe30 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:51.671293 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-14041de2-e694-42e8-af5c-aed1bd6cfe30 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:51.678677 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-14041de2-e694-42e8-af5c-aed1bd6cfe30 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.154401 Jul 12 17:26:51.679240 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 65/150] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:51 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:52.539109 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b5e8ef06-cb56-41e2-880b-ec43daf8b4ba tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:52.539723 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b5e8ef06-cb56-41e2-880b-ec43daf8b4ba tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:52.546593 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b5e8ef06-cb56-41e2-880b-ec43daf8b4ba tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:52.547069 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b5e8ef06-cb56-41e2-880b-ec43daf8b4ba tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:52.547836 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b5e8ef06-cb56-41e2-880b-ec43daf8b4ba tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:52.548272 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b5e8ef06-cb56-41e2-880b-ec43daf8b4ba tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:52.550290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-de559958-5d89-4415-8337-bf5ffd4954b6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:52.550906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-de559958-5d89-4415-8337-bf5ffd4954b6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:52.558373 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-de559958-5d89-4415-8337-bf5ffd4954b6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:52.558823 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-de559958-5d89-4415-8337-bf5ffd4954b6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:52.559601 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-de559958-5d89-4415-8337-bf5ffd4954b6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:52.560033 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-de559958-5d89-4415-8337-bf5ffd4954b6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:52.742929 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b5e8ef06-cb56-41e2-880b-ec43daf8b4ba tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:52.749770 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-de559958-5d89-4415-8337-bf5ffd4954b6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:52.751406 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b5e8ef06-cb56-41e2-880b-ec43daf8b4ba tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.216205 Jul 12 17:26:52.752222 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 86/151] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:52 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:52.756428 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f127e723-2c31-4724-ab28-034e1c71da76 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:52.757032 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f127e723-2c31-4724-ab28-034e1c71da76 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:52.763159 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f127e723-2c31-4724-ab28-034e1c71da76 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:52.763741 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f127e723-2c31-4724-ab28-034e1c71da76 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:52.764518 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f127e723-2c31-4724-ab28-034e1c71da76 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:52.765021 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f127e723-2c31-4724-ab28-034e1c71da76 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:52.768766 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-de559958-5d89-4415-8337-bf5ffd4954b6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.222183 Jul 12 17:26:52.775415 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 66/152] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:52 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:26:52.900918 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f127e723-2c31-4724-ab28-034e1c71da76 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:52.908389 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f127e723-2c31-4724-ab28-034e1c71da76 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.155461 Jul 12 17:26:52.908951 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 87/153] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:52 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:53.312700 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-5fbe79e1-2f33-4e1d-9326-b6eef6d292d4 req-0f877391-8af7-473f-ac0e-0802955366bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec1a3e3c-1467-458b-ace6-0ff381218e4a", "name": "network-vif-plugged", "status": "completed", "tag": "7fe73886-acc0-410d-b06c-1db1396a9c76"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:26:53.321007 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-5fbe79e1-2f33-4e1d-9326-b6eef6d292d4 req-0f877391-8af7-473f-ac0e-0802955366bf service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:53.322177 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-5fbe79e1-2f33-4e1d-9326-b6eef6d292d4 req-0f877391-8af7-473f-ac0e-0802955366bf service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:53.333189 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-5fbe79e1-2f33-4e1d-9326-b6eef6d292d4 req-0f877391-8af7-473f-ac0e-0802955366bf service nova] Creating event network-vif-plugged:7fe73886-acc0-410d-b06c-1db1396a9c76 for instance ec1a3e3c-1467-458b-ace6-0ff381218e4a on hv-cinder-84932 Jul 12 17:26:53.338329 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-5fbe79e1-2f33-4e1d-9326-b6eef6d292d4 req-0f877391-8af7-473f-ac0e-0802955366bf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029336 Jul 12 17:26:53.338917 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 67/154] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:26:53.767802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6d05ae4e-3e1d-4c14-b203-c1cf31e3dae2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:53.768439 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6d05ae4e-3e1d-4c14-b203-c1cf31e3dae2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:53.774908 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6d05ae4e-3e1d-4c14-b203-c1cf31e3dae2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:53.775354 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6d05ae4e-3e1d-4c14-b203-c1cf31e3dae2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:53.776113 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6d05ae4e-3e1d-4c14-b203-c1cf31e3dae2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:53.776547 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6d05ae4e-3e1d-4c14-b203-c1cf31e3dae2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:53.786774 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-49f8f7a0-4725-4cb3-86ee-9874c293af69 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:53.787616 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-49f8f7a0-4725-4cb3-86ee-9874c293af69 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:53.795172 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-49f8f7a0-4725-4cb3-86ee-9874c293af69 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:53.795620 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-49f8f7a0-4725-4cb3-86ee-9874c293af69 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:53.796405 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-49f8f7a0-4725-4cb3-86ee-9874c293af69 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:53.796843 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-49f8f7a0-4725-4cb3-86ee-9874c293af69 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:54.013450 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-49f8f7a0-4725-4cb3-86ee-9874c293af69 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:54.016226 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6d05ae4e-3e1d-4c14-b203-c1cf31e3dae2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:54.023605 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-49f8f7a0-4725-4cb3-86ee-9874c293af69 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.241592 Jul 12 17:26:54.023784 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6d05ae4e-3e1d-4c14-b203-c1cf31e3dae2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.259741 Jul 12 17:26:54.034354 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 88/155] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:53 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:54.034354 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5da7ba5e-1c58-46b4-bac8-16a67a8d0566 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:54.034354 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5da7ba5e-1c58-46b4-bac8-16a67a8d0566 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:54.036092 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 68/156] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:53 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:54.040503 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5da7ba5e-1c58-46b4-bac8-16a67a8d0566 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:54.040945 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5da7ba5e-1c58-46b4-bac8-16a67a8d0566 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:54.042279 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5da7ba5e-1c58-46b4-bac8-16a67a8d0566 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:54.042705 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5da7ba5e-1c58-46b4-bac8-16a67a8d0566 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:54.232597 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5da7ba5e-1c58-46b4-bac8-16a67a8d0566 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:54.236313 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:26:54.244483 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5da7ba5e-1c58-46b4-bac8-16a67a8d0566 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.217494 Jul 12 17:26:54.245068 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 89/157] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:54 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:55.041315 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-29775c1b-a08a-42b4-89b7-2d297b5edd7c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:55.041988 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-29775c1b-a08a-42b4-89b7-2d297b5edd7c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:55.048191 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-29775c1b-a08a-42b4-89b7-2d297b5edd7c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:55.049002 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-29775c1b-a08a-42b4-89b7-2d297b5edd7c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:55.050079 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-29775c1b-a08a-42b4-89b7-2d297b5edd7c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:55.050727 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-29775c1b-a08a-42b4-89b7-2d297b5edd7c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:55.052594 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cc587ca6-3387-4528-9eec-119b6efa7aae tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:55.053243 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cc587ca6-3387-4528-9eec-119b6efa7aae tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:55.060941 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cc587ca6-3387-4528-9eec-119b6efa7aae tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:55.061395 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cc587ca6-3387-4528-9eec-119b6efa7aae tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:55.062259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cc587ca6-3387-4528-9eec-119b6efa7aae tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:55.062698 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cc587ca6-3387-4528-9eec-119b6efa7aae tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:55.257123 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-29775c1b-a08a-42b4-89b7-2d297b5edd7c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:55.260622 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cc587ca6-3387-4528-9eec-119b6efa7aae tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:55.264898 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-29775c1b-a08a-42b4-89b7-2d297b5edd7c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.227366 Jul 12 17:26:55.265664 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 69/158] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:55 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:55.268376 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cc587ca6-3387-4528-9eec-119b6efa7aae tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.219638 Jul 12 17:26:55.268948 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 90/159] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:55 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:55.278361 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e8d1e817-7b2a-4dcb-b2d8-06d5e69780a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:55.278964 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e8d1e817-7b2a-4dcb-b2d8-06d5e69780a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:55.284945 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e8d1e817-7b2a-4dcb-b2d8-06d5e69780a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:55.285423 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e8d1e817-7b2a-4dcb-b2d8-06d5e69780a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:55.286218 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e8d1e817-7b2a-4dcb-b2d8-06d5e69780a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:55.286651 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e8d1e817-7b2a-4dcb-b2d8-06d5e69780a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:55.440007 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e8d1e817-7b2a-4dcb-b2d8-06d5e69780a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:55.448502 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e8d1e817-7b2a-4dcb-b2d8-06d5e69780a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.173759 Jul 12 17:26:55.449547 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 70/160] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:55 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:55.638712 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-86ed15d0-af72-40e2-9b4d-bdb3787b3644 req-38ac690f-aaa4-451f-8822-ef6ff67505f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4b5fa1-33f6-4da9-9411-e89b13939d30", "name": "network-vif-plugged", "status": "completed", "tag": "3616dee8-6bc4-4fb6-b034-e3ea6a8c7adc"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:26:55.647510 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-86ed15d0-af72-40e2-9b4d-bdb3787b3644 req-38ac690f-aaa4-451f-8822-ef6ff67505f2 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:55.648199 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-86ed15d0-af72-40e2-9b4d-bdb3787b3644 req-38ac690f-aaa4-451f-8822-ef6ff67505f2 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:55.660016 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-86ed15d0-af72-40e2-9b4d-bdb3787b3644 req-38ac690f-aaa4-451f-8822-ef6ff67505f2 service nova] Creating event network-vif-plugged:3616dee8-6bc4-4fb6-b034-e3ea6a8c7adc for instance cc4b5fa1-33f6-4da9-9411-e89b13939d30 on hv-cinder-84932 Jul 12 17:26:55.667932 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-86ed15d0-af72-40e2-9b4d-bdb3787b3644 req-38ac690f-aaa4-451f-8822-ef6ff67505f2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031330 Jul 12 17:26:55.669104 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 91/161] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:26:56.294730 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-600ed2cf-7662-44d6-873e-00274106c497 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:56.294730 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-600ed2cf-7662-44d6-873e-00274106c497 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:56.301782 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-09e7c401-090f-4b71-8ca7-f732bb5d5a0a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:56.302591 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-09e7c401-090f-4b71-8ca7-f732bb5d5a0a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:56.305535 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-600ed2cf-7662-44d6-873e-00274106c497 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:56.306020 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-600ed2cf-7662-44d6-873e-00274106c497 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:56.307327 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-600ed2cf-7662-44d6-873e-00274106c497 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:56.307785 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-600ed2cf-7662-44d6-873e-00274106c497 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:56.315438 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-09e7c401-090f-4b71-8ca7-f732bb5d5a0a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:56.315828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-09e7c401-090f-4b71-8ca7-f732bb5d5a0a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:56.316724 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-09e7c401-090f-4b71-8ca7-f732bb5d5a0a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:56.317231 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-09e7c401-090f-4b71-8ca7-f732bb5d5a0a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:56.589677 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-600ed2cf-7662-44d6-873e-00274106c497 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:56.600407 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-600ed2cf-7662-44d6-873e-00274106c497 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.318346 Jul 12 17:26:56.614614 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 92/162] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:56 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:56.617939 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-09e7c401-090f-4b71-8ca7-f732bb5d5a0a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:56.620474 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f542d339-780f-469a-91b3-6ab428d46353 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:56.621106 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f542d339-780f-469a-91b3-6ab428d46353 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:56.627274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f542d339-780f-469a-91b3-6ab428d46353 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:56.627740 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f542d339-780f-469a-91b3-6ab428d46353 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:56.628535 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f542d339-780f-469a-91b3-6ab428d46353 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:56.629059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f542d339-780f-469a-91b3-6ab428d46353 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:56.635831 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-09e7c401-090f-4b71-8ca7-f732bb5d5a0a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.357313 Jul 12 17:26:56.637101 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 71/163] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:56 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:56.889186 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f542d339-780f-469a-91b3-6ab428d46353 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:56.921267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f542d339-780f-469a-91b3-6ab428d46353 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.305099 Jul 12 17:26:56.922855 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 93/164] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:56 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:57.622058 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8b9a2493-df4b-4027-b650-592e35274fad tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:57.623522 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8b9a2493-df4b-4027-b650-592e35274fad tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:57.633152 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8b9a2493-df4b-4027-b650-592e35274fad tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:57.636589 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8b9a2493-df4b-4027-b650-592e35274fad tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:57.637801 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8b9a2493-df4b-4027-b650-592e35274fad tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:57.638576 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8b9a2493-df4b-4027-b650-592e35274fad tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:57.653585 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1ef91212-3392-49d1-bfbe-4d9ef62922d4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:57.654969 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1ef91212-3392-49d1-bfbe-4d9ef62922d4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:57.671112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1ef91212-3392-49d1-bfbe-4d9ef62922d4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:57.671582 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1ef91212-3392-49d1-bfbe-4d9ef62922d4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:57.672383 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1ef91212-3392-49d1-bfbe-4d9ef62922d4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:57.674620 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1ef91212-3392-49d1-bfbe-4d9ef62922d4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:57.940896 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8b9a2493-df4b-4027-b650-592e35274fad tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:57.944307 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:26:57.951803 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1ef91212-3392-49d1-bfbe-4d9ef62922d4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:57.959885 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1ef91212-3392-49d1-bfbe-4d9ef62922d4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.311310 Jul 12 17:26:57.971234 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8b9a2493-df4b-4027-b650-592e35274fad tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.346790 Jul 12 17:26:57.972223 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 94/165] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:57 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:26:57.977036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-394b20b7-34e6-4d19-b960-dc641fde8445 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:57.977645 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-394b20b7-34e6-4d19-b960-dc641fde8445 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:57.979570 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 72/166] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:57 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:57.984044 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-394b20b7-34e6-4d19-b960-dc641fde8445 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:57.984674 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-394b20b7-34e6-4d19-b960-dc641fde8445 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:57.985591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-394b20b7-34e6-4d19-b960-dc641fde8445 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:57.986213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-394b20b7-34e6-4d19-b960-dc641fde8445 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:58.147151 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-394b20b7-34e6-4d19-b960-dc641fde8445 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:58.157575 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-394b20b7-34e6-4d19-b960-dc641fde8445 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.184160 Jul 12 17:26:58.158689 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 95/167] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:57 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:58.990531 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-35c4bf2c-1f56-4b3a-ad0e-d1d69f48eb8a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:58.993915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-35c4bf2c-1f56-4b3a-ad0e-d1d69f48eb8a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:58.994656 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c2e45ea4-85a4-44ef-b5d7-44c8a2535191 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:58.997013 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c2e45ea4-85a4-44ef-b5d7-44c8a2535191 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:59.012333 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-35c4bf2c-1f56-4b3a-ad0e-d1d69f48eb8a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:59.012868 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-35c4bf2c-1f56-4b3a-ad0e-d1d69f48eb8a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:59.014949 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c2e45ea4-85a4-44ef-b5d7-44c8a2535191 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:59.015348 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c2e45ea4-85a4-44ef-b5d7-44c8a2535191 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:59.017214 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-35c4bf2c-1f56-4b3a-ad0e-d1d69f48eb8a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:59.018892 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c2e45ea4-85a4-44ef-b5d7-44c8a2535191 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:59.019333 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c2e45ea4-85a4-44ef-b5d7-44c8a2535191 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:59.019944 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-35c4bf2c-1f56-4b3a-ad0e-d1d69f48eb8a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:59.303175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c2e45ea4-85a4-44ef-b5d7-44c8a2535191 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:59.313310 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c2e45ea4-85a4-44ef-b5d7-44c8a2535191 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1322 microversion: 2.1 time: 0.338862 Jul 12 17:26:59.315446 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 73/168] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:58 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:59.316984 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-35c4bf2c-1f56-4b3a-ad0e-d1d69f48eb8a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:59.326291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-35c4bf2c-1f56-4b3a-ad0e-d1d69f48eb8a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1313 microversion: 2.1 time: 0.341944 Jul 12 17:26:59.329963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-622c3424-2cc5-4270-ad3d-60bb9f172874 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:26:59.329963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-622c3424-2cc5-4270-ad3d-60bb9f172874 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:26:59.341561 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 96/169] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:58 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:59.341775 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-622c3424-2cc5-4270-ad3d-60bb9f172874 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:59.341775 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-622c3424-2cc5-4270-ad3d-60bb9f172874 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:59.341775 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-622c3424-2cc5-4270-ad3d-60bb9f172874 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:26:59.341775 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-622c3424-2cc5-4270-ad3d-60bb9f172874 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:26:59.495607 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-622c3424-2cc5-4270-ad3d-60bb9f172874 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:26:59.504346 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-622c3424-2cc5-4270-ad3d-60bb9f172874 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.187863 Jul 12 17:26:59.505429 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 74/170] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:26:59 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:26:59.993973 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-2ebc4ae1-6dd9-4f62-8ee1-4217dca5d7d0 req-cbccc476-e65f-4459-b70d-43225260ce19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58fa8d33-4b3c-45f2-8d46-38f4f5932cf2", "name": "network-vif-plugged", "status": "completed", "tag": "b8875684-ac70-4178-b58c-59ccedcabb36"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:27:00.004276 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-2ebc4ae1-6dd9-4f62-8ee1-4217dca5d7d0 req-cbccc476-e65f-4459-b70d-43225260ce19 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:00.004783 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-2ebc4ae1-6dd9-4f62-8ee1-4217dca5d7d0 req-cbccc476-e65f-4459-b70d-43225260ce19 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:00.025980 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-2ebc4ae1-6dd9-4f62-8ee1-4217dca5d7d0 req-cbccc476-e65f-4459-b70d-43225260ce19 service nova] Creating event network-vif-plugged:b8875684-ac70-4178-b58c-59ccedcabb36 for instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 on hv-cinder-84932 Jul 12 17:27:00.031869 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-2ebc4ae1-6dd9-4f62-8ee1-4217dca5d7d0 req-cbccc476-e65f-4459-b70d-43225260ce19 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042385 Jul 12 17:27:00.032629 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 97/171] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:27:00.332085 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4f89ff48-05e0-4e13-945e-48c1367571fd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:00.332689 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4f89ff48-05e0-4e13-945e-48c1367571fd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:00.339171 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4f89ff48-05e0-4e13-945e-48c1367571fd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:00.339603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4f89ff48-05e0-4e13-945e-48c1367571fd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:00.340358 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4f89ff48-05e0-4e13-945e-48c1367571fd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:00.340784 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4f89ff48-05e0-4e13-945e-48c1367571fd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:00.349491 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d5908468-96ac-4ee7-828e-e7c7fb00366a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:00.350217 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d5908468-96ac-4ee7-828e-e7c7fb00366a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:00.357270 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d5908468-96ac-4ee7-828e-e7c7fb00366a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:00.357764 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d5908468-96ac-4ee7-828e-e7c7fb00366a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:00.358518 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d5908468-96ac-4ee7-828e-e7c7fb00366a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:00.358952 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d5908468-96ac-4ee7-828e-e7c7fb00366a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:00.537641 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4f89ff48-05e0-4e13-945e-48c1367571fd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:00.541711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d5908468-96ac-4ee7-828e-e7c7fb00366a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:00.545059 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4f89ff48-05e0-4e13-945e-48c1367571fd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1516 microversion: 2.1 time: 0.216713 Jul 12 17:27:00.545661 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 75/172] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:00 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1516 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:00.550230 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-daf77259-1009-4dd4-b17a-68c1c84a7f40 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:00.550835 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-daf77259-1009-4dd4-b17a-68c1c84a7f40 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:00.552501 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d5908468-96ac-4ee7-828e-e7c7fb00366a tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1500 microversion: 2.1 time: 0.207141 Jul 12 17:27:00.553237 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 98/173] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:00 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1500 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:27:00.558465 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-daf77259-1009-4dd4-b17a-68c1c84a7f40 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:00.558926 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-daf77259-1009-4dd4-b17a-68c1c84a7f40 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:00.559738 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-daf77259-1009-4dd4-b17a-68c1c84a7f40 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:00.560174 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-daf77259-1009-4dd4-b17a-68c1c84a7f40 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:00.563225 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8a760d42-a76f-4338-b928-539b1c2dcf63 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:27:00.564189 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8a760d42-a76f-4338-b928-539b1c2dcf63 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:00.570831 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8a760d42-a76f-4338-b928-539b1c2dcf63 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:00.571626 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8a760d42-a76f-4338-b928-539b1c2dcf63 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:00.572761 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8a760d42-a76f-4338-b928-539b1c2dcf63 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:00.573729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8a760d42-a76f-4338-b928-539b1c2dcf63 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:00.634152 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-8a760d42-a76f-4338-b928-539b1c2dcf63 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lazy-loading 'flavor' on Instance uuid cc4b5fa1-33f6-4da9-9411-e89b13939d30 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:27:00.726501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-daf77259-1009-4dd4-b17a-68c1c84a7f40 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:00.733843 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-daf77259-1009-4dd4-b17a-68c1c84a7f40 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.187159 Jul 12 17:27:00.734611 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 76/174] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:00 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:00.778480 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8a760d42-a76f-4338-b928-539b1c2dcf63 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "POST /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30/action" status: 200 len: 32 microversion: 2.1 time: 0.220136 Jul 12 17:27:00.779170 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 99/175] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Jul 12 17:27:00 2022] POST /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30/action => generated 32 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 17:27:00.788095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-fdc53509-84ff-4734-a39c-74568a54b230 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:00.788712 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-fdc53509-84ff-4734-a39c-74568a54b230 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:00.794972 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fdc53509-84ff-4734-a39c-74568a54b230 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:00.795414 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fdc53509-84ff-4734-a39c-74568a54b230 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:00.796168 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fdc53509-84ff-4734-a39c-74568a54b230 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:00.796596 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fdc53509-84ff-4734-a39c-74568a54b230 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:00.950963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fdc53509-84ff-4734-a39c-74568a54b230 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:00.958536 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-fdc53509-84ff-4734-a39c-74568a54b230 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.174261 Jul 12 17:27:00.959113 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 77/176] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:00 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:01.756493 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-58acd2ae-f924-4cb4-ab47-d6ebb4a36f3e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:01.757517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-58acd2ae-f924-4cb4-ab47-d6ebb4a36f3e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:01.763792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=80 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:01.784339 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-58acd2ae-f924-4cb4-ab47-d6ebb4a36f3e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:01.784912 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-58acd2ae-f924-4cb4-ab47-d6ebb4a36f3e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:01.785678 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-58acd2ae-f924-4cb4-ab47-d6ebb4a36f3e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:01.786585 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-58acd2ae-f924-4cb4-ab47-d6ebb4a36f3e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:01.969898 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-58acd2ae-f924-4cb4-ab47-d6ebb4a36f3e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:01.977049 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-fe0a6db3-3568-4e19-94f6-08c013f47156 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:01.977662 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-fe0a6db3-3568-4e19-94f6-08c013f47156 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:01.977789 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-58acd2ae-f924-4cb4-ab47-d6ebb4a36f3e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.229274 Jul 12 17:27:01.978561 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 100/177] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:01 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:01.983748 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fe0a6db3-3568-4e19-94f6-08c013f47156 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:01.987533 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fe0a6db3-3568-4e19-94f6-08c013f47156 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:01.988398 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fe0a6db3-3568-4e19-94f6-08c013f47156 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:01.988841 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fe0a6db3-3568-4e19-94f6-08c013f47156 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:02.127230 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fe0a6db3-3568-4e19-94f6-08c013f47156 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:02.135475 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-fe0a6db3-3568-4e19-94f6-08c013f47156 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.162987 Jul 12 17:27:02.136057 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 78/178] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:01 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:02.994973 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-beb26714-69cc-44b1-8d4d-8e427a5d3ae5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:02.995625 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-beb26714-69cc-44b1-8d4d-8e427a5d3ae5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:03.001665 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-beb26714-69cc-44b1-8d4d-8e427a5d3ae5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:03.002156 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-beb26714-69cc-44b1-8d4d-8e427a5d3ae5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:03.002913 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-beb26714-69cc-44b1-8d4d-8e427a5d3ae5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:03.003341 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-beb26714-69cc-44b1-8d4d-8e427a5d3ae5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:03.024911 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-879f8a1f-44f6-4203-9652-2206ddad9d14 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d225d3e0-faa6-4bfb-a170-704708940880"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:27:03.027233 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-879f8a1f-44f6-4203-9652-2206ddad9d14 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:03.029320 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=78 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:03.035519 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-879f8a1f-44f6-4203-9652-2206ddad9d14 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:03.036112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-879f8a1f-44f6-4203-9652-2206ddad9d14 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:03.037097 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-879f8a1f-44f6-4203-9652-2206ddad9d14 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:03.037601 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-879f8a1f-44f6-4203-9652-2206ddad9d14 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:03.208216 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-beb26714-69cc-44b1-8d4d-8e427a5d3ae5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:03.217810 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-beb26714-69cc-44b1-8d4d-8e427a5d3ae5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.227160 Jul 12 17:27:03.222589 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 101/179] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:02 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:03.228064 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-66df3d9b-af04-467d-801a-e8fcd13f977a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:03.229407 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-66df3d9b-af04-467d-801a-e8fcd13f977a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:03.235484 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66df3d9b-af04-467d-801a-e8fcd13f977a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:03.235930 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66df3d9b-af04-467d-801a-e8fcd13f977a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:03.236693 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66df3d9b-af04-467d-801a-e8fcd13f977a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:03.237126 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66df3d9b-af04-467d-801a-e8fcd13f977a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:03.449936 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-66df3d9b-af04-467d-801a-e8fcd13f977a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:03.463907 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-66df3d9b-af04-467d-801a-e8fcd13f977a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.238959 Jul 12 17:27:03.464495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 102/180] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:03 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:03.483231 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-879f8a1f-44f6-4203-9652-2206ddad9d14 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "POST /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.462027 Jul 12 17:27:03.483978 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 79/181] 10.222.0.62 () {60 vars in 1322 bytes} [Tue Jul 12 17:27:03 2022] POST /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a/os-volume_attachments => generated 194 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:27:04.234924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-02fe1be2-8c3d-46af-9c53-3584af1e6f5e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:04.235560 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-02fe1be2-8c3d-46af-9c53-3584af1e6f5e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:04.241659 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02fe1be2-8c3d-46af-9c53-3584af1e6f5e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:04.242144 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02fe1be2-8c3d-46af-9c53-3584af1e6f5e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:04.242898 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02fe1be2-8c3d-46af-9c53-3584af1e6f5e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:04.243497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02fe1be2-8c3d-46af-9c53-3584af1e6f5e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:04.485904 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-451fb337-ef61-49b4-9b0a-15a1439f3f99 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:04.486598 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-451fb337-ef61-49b4-9b0a-15a1439f3f99 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:04.495890 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-451fb337-ef61-49b4-9b0a-15a1439f3f99 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:04.496466 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-451fb337-ef61-49b4-9b0a-15a1439f3f99 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:04.497339 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-451fb337-ef61-49b4-9b0a-15a1439f3f99 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:04.497889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-451fb337-ef61-49b4-9b0a-15a1439f3f99 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:04.573536 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-02fe1be2-8c3d-46af-9c53-3584af1e6f5e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:04.581283 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-02fe1be2-8c3d-46af-9c53-3584af1e6f5e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.350076 Jul 12 17:27:04.583422 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 103/182] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:04 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:04.649188 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-451fb337-ef61-49b4-9b0a-15a1439f3f99 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:04.657217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-451fb337-ef61-49b4-9b0a-15a1439f3f99 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.176009 Jul 12 17:27:04.657820 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 80/183] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:04 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:27:05.600961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-72d854d6-2487-440d-a484-03fbc54fe7ec tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:05.601625 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-72d854d6-2487-440d-a484-03fbc54fe7ec tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:05.607583 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-72d854d6-2487-440d-a484-03fbc54fe7ec tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:05.608022 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-72d854d6-2487-440d-a484-03fbc54fe7ec tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:05.608779 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-72d854d6-2487-440d-a484-03fbc54fe7ec tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:05.609282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-72d854d6-2487-440d-a484-03fbc54fe7ec tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:05.674696 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-58530e71-c077-45e8-ba58-90c8f3676531 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:05.675309 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-58530e71-c077-45e8-ba58-90c8f3676531 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:05.682466 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-58530e71-c077-45e8-ba58-90c8f3676531 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:05.682916 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-58530e71-c077-45e8-ba58-90c8f3676531 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:05.683685 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-58530e71-c077-45e8-ba58-90c8f3676531 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:05.684121 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-58530e71-c077-45e8-ba58-90c8f3676531 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:05.785333 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-72d854d6-2487-440d-a484-03fbc54fe7ec tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:05.793099 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-72d854d6-2487-440d-a484-03fbc54fe7ec tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.196086 Jul 12 17:27:05.793680 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 104/184] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:05 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:05.830301 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-58530e71-c077-45e8-ba58-90c8f3676531 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:05.837596 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-58530e71-c077-45e8-ba58-90c8f3676531 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.166739 Jul 12 17:27:05.838182 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 81/185] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:05 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:27:06.810310 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6d9a749b-e01c-40df-b684-a5c5ba036786 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:06.810922 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6d9a749b-e01c-40df-b684-a5c5ba036786 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:06.817018 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6d9a749b-e01c-40df-b684-a5c5ba036786 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:06.817476 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6d9a749b-e01c-40df-b684-a5c5ba036786 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:06.818292 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6d9a749b-e01c-40df-b684-a5c5ba036786 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:06.818724 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6d9a749b-e01c-40df-b684-a5c5ba036786 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:06.853914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6b7f5320-b224-416e-b382-7a88bb3b0660 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:06.854590 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6b7f5320-b224-416e-b382-7a88bb3b0660 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:06.863285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6b7f5320-b224-416e-b382-7a88bb3b0660 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:06.863970 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6b7f5320-b224-416e-b382-7a88bb3b0660 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:06.864891 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6b7f5320-b224-416e-b382-7a88bb3b0660 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:06.865325 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6b7f5320-b224-416e-b382-7a88bb3b0660 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:07.005235 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6d9a749b-e01c-40df-b684-a5c5ba036786 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:07.008606 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:07.014150 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6d9a749b-e01c-40df-b684-a5c5ba036786 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.208098 Jul 12 17:27:07.014724 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 105/186] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:06 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:07.031798 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6b7f5320-b224-416e-b382-7a88bb3b0660 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:07.039574 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6b7f5320-b224-416e-b382-7a88bb3b0660 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.189442 Jul 12 17:27:07.040142 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 82/187] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:06 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:27:08.031586 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5d049a7c-0c0a-4cb9-a574-96384920b214 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:08.032192 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5d049a7c-0c0a-4cb9-a574-96384920b214 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:08.039979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5d049a7c-0c0a-4cb9-a574-96384920b214 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:08.040468 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5d049a7c-0c0a-4cb9-a574-96384920b214 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:08.041332 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5d049a7c-0c0a-4cb9-a574-96384920b214 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:08.041784 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5d049a7c-0c0a-4cb9-a574-96384920b214 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:08.056319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-eac508b6-0454-4e26-8160-98a2c551b058 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:08.056931 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-eac508b6-0454-4e26-8160-98a2c551b058 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:08.063926 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eac508b6-0454-4e26-8160-98a2c551b058 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:08.064379 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eac508b6-0454-4e26-8160-98a2c551b058 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:08.065150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eac508b6-0454-4e26-8160-98a2c551b058 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:08.065587 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eac508b6-0454-4e26-8160-98a2c551b058 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:08.237092 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5d049a7c-0c0a-4cb9-a574-96384920b214 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:08.241228 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-eac508b6-0454-4e26-8160-98a2c551b058 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:08.244419 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5d049a7c-0c0a-4cb9-a574-96384920b214 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.216707 Jul 12 17:27:08.244985 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 106/188] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:08 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:08.249437 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-eac508b6-0454-4e26-8160-98a2c551b058 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.196903 Jul 12 17:27:08.250193 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 83/189] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:08 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:27:09.261678 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-373d8869-d3b0-41f3-84ae-fb4d9a42d8db tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:09.262364 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-373d8869-d3b0-41f3-84ae-fb4d9a42d8db tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:09.266098 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e36f2384-fac8-4988-813e-54777dbb76d1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:09.266710 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e36f2384-fac8-4988-813e-54777dbb76d1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:09.268400 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-373d8869-d3b0-41f3-84ae-fb4d9a42d8db tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:09.268845 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-373d8869-d3b0-41f3-84ae-fb4d9a42d8db tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:09.269599 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-373d8869-d3b0-41f3-84ae-fb4d9a42d8db tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:09.270052 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-373d8869-d3b0-41f3-84ae-fb4d9a42d8db tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:09.273226 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e36f2384-fac8-4988-813e-54777dbb76d1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:09.273673 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e36f2384-fac8-4988-813e-54777dbb76d1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:09.274459 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e36f2384-fac8-4988-813e-54777dbb76d1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:09.274892 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e36f2384-fac8-4988-813e-54777dbb76d1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:09.454376 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-373d8869-d3b0-41f3-84ae-fb4d9a42d8db tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:09.465923 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e36f2384-fac8-4988-813e-54777dbb76d1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:09.469950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-373d8869-d3b0-41f3-84ae-fb4d9a42d8db tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1368 microversion: 2.1 time: 0.211494 Jul 12 17:27:09.476393 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 107/190] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:09 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:09.478366 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e36f2384-fac8-4988-813e-54777dbb76d1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.216166 Jul 12 17:27:09.479021 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 84/191] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:09 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:27:10.486762 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fd534e56-a1ba-4ad2-9c7b-1e19e043ac20 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:10.487377 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fd534e56-a1ba-4ad2-9c7b-1e19e043ac20 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:10.493879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fd534e56-a1ba-4ad2-9c7b-1e19e043ac20 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:10.494512 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fd534e56-a1ba-4ad2-9c7b-1e19e043ac20 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:10.496235 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fd534e56-a1ba-4ad2-9c7b-1e19e043ac20 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:10.496820 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fd534e56-a1ba-4ad2-9c7b-1e19e043ac20 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:10.498296 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f2a756b8-0fe5-4e98-ad0f-92945166c23c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:10.499356 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f2a756b8-0fe5-4e98-ad0f-92945166c23c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:10.508555 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f2a756b8-0fe5-4e98-ad0f-92945166c23c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:10.509512 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f2a756b8-0fe5-4e98-ad0f-92945166c23c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:10.510745 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f2a756b8-0fe5-4e98-ad0f-92945166c23c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:10.511658 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f2a756b8-0fe5-4e98-ad0f-92945166c23c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:10.695291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fd534e56-a1ba-4ad2-9c7b-1e19e043ac20 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:10.703351 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fd534e56-a1ba-4ad2-9c7b-1e19e043ac20 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1559 microversion: 2.1 time: 0.220573 Jul 12 17:27:10.703955 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 108/192] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:10 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:10.720523 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3747f5bf-f2d1-467b-a705-86e77a7fadbb tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:10.721039 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3747f5bf-f2d1-467b-a705-86e77a7fadbb tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:10.721455 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f2a756b8-0fe5-4e98-ad0f-92945166c23c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:10.727003 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3747f5bf-f2d1-467b-a705-86e77a7fadbb tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:10.727444 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3747f5bf-f2d1-467b-a705-86e77a7fadbb tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:10.728195 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3747f5bf-f2d1-467b-a705-86e77a7fadbb tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:10.728625 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3747f5bf-f2d1-467b-a705-86e77a7fadbb tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:10.729323 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f2a756b8-0fe5-4e98-ad0f-92945166c23c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.236619 Jul 12 17:27:10.730566 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 85/193] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:10 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:10.804855 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3747f5bf-f2d1-467b-a705-86e77a7fadbb tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088120 Jul 12 17:27:10.805458 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 109/194] 10.222.0.62 () {58 vars in 1274 bytes} [Tue Jul 12 17:27:10 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:27:11.747823 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5c108a6d-702a-41b9-aae1-df085f573864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:11.754571 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5c108a6d-702a-41b9-aae1-df085f573864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:11.761485 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5c108a6d-702a-41b9-aae1-df085f573864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:11.761977 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5c108a6d-702a-41b9-aae1-df085f573864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:11.762764 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5c108a6d-702a-41b9-aae1-df085f573864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:11.763204 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5c108a6d-702a-41b9-aae1-df085f573864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:12.014960 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5c108a6d-702a-41b9-aae1-df085f573864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:12.022504 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5c108a6d-702a-41b9-aae1-df085f573864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.279410 Jul 12 17:27:12.023164 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 86/195] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:11 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:12.155640 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-fa906892-208b-4da8-8d39-bf1dff35c3a0 req-c24e301b-92f7-4994-ab8e-b6c2f714b5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58fa8d33-4b3c-45f2-8d46-38f4f5932cf2", "tag": "b8875684-ac70-4178-b58c-59ccedcabb36"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:27:12.163592 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-fa906892-208b-4da8-8d39-bf1dff35c3a0 req-c24e301b-92f7-4994-ab8e-b6c2f714b5b0 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:12.164031 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-fa906892-208b-4da8-8d39-bf1dff35c3a0 req-c24e301b-92f7-4994-ab8e-b6c2f714b5b0 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:12.177451 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-fa906892-208b-4da8-8d39-bf1dff35c3a0 req-c24e301b-92f7-4994-ab8e-b6c2f714b5b0 service nova] Creating event network-changed:b8875684-ac70-4178-b58c-59ccedcabb36 for instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 on hv-cinder-84932 Jul 12 17:27:12.182570 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-fa906892-208b-4da8-8d39-bf1dff35c3a0 req-c24e301b-92f7-4994-ab8e-b6c2f714b5b0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031064 Jul 12 17:27:12.183357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 110/196] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:27:13.048210 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a39ee775-774d-4211-85b8-d1905df360dd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:13.048680 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a39ee775-774d-4211-85b8-d1905df360dd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:13.055470 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a39ee775-774d-4211-85b8-d1905df360dd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:13.056039 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a39ee775-774d-4211-85b8-d1905df360dd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:13.057003 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a39ee775-774d-4211-85b8-d1905df360dd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:13.057562 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a39ee775-774d-4211-85b8-d1905df360dd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:13.186414 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a39ee775-774d-4211-85b8-d1905df360dd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:13.193732 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a39ee775-774d-4211-85b8-d1905df360dd tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.157767 Jul 12 17:27:13.194308 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 87/197] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:13 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:14.210509 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5eb0f6de-e276-4efb-aa81-d50df47fe556 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:14.211209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5eb0f6de-e276-4efb-aa81-d50df47fe556 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:14.218031 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5eb0f6de-e276-4efb-aa81-d50df47fe556 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:14.218485 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5eb0f6de-e276-4efb-aa81-d50df47fe556 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:14.219253 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5eb0f6de-e276-4efb-aa81-d50df47fe556 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:14.219688 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5eb0f6de-e276-4efb-aa81-d50df47fe556 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:14.444659 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5eb0f6de-e276-4efb-aa81-d50df47fe556 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:14.452864 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5eb0f6de-e276-4efb-aa81-d50df47fe556 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.246589 Jul 12 17:27:14.453437 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 111/198] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:14 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:15.470019 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c72d66d5-ac91-4d41-b402-4fd1443f86a0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:15.470632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c72d66d5-ac91-4d41-b402-4fd1443f86a0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:15.477111 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c72d66d5-ac91-4d41-b402-4fd1443f86a0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:15.477551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c72d66d5-ac91-4d41-b402-4fd1443f86a0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:15.478362 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c72d66d5-ac91-4d41-b402-4fd1443f86a0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:15.478789 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c72d66d5-ac91-4d41-b402-4fd1443f86a0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:15.482843 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:15.620268 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c72d66d5-ac91-4d41-b402-4fd1443f86a0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:15.628189 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c72d66d5-ac91-4d41-b402-4fd1443f86a0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.162009 Jul 12 17:27:15.628963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 88/199] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:15 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:16.645411 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-275ef9a8-9437-41a5-9cc9-77f1c3e337cf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:16.645976 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-275ef9a8-9437-41a5-9cc9-77f1c3e337cf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:16.652437 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-275ef9a8-9437-41a5-9cc9-77f1c3e337cf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:16.652885 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-275ef9a8-9437-41a5-9cc9-77f1c3e337cf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:16.653639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-275ef9a8-9437-41a5-9cc9-77f1c3e337cf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:16.654104 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-275ef9a8-9437-41a5-9cc9-77f1c3e337cf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:16.784877 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-275ef9a8-9437-41a5-9cc9-77f1c3e337cf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:16.792914 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-275ef9a8-9437-41a5-9cc9-77f1c3e337cf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.150819 Jul 12 17:27:16.793486 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 112/200] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:16 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:17.810266 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7f889c4b-ff0b-423a-aeda-410d03b4a5d4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:17.811231 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7f889c4b-ff0b-423a-aeda-410d03b4a5d4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:17.818284 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f889c4b-ff0b-423a-aeda-410d03b4a5d4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:17.818950 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f889c4b-ff0b-423a-aeda-410d03b4a5d4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:17.819898 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f889c4b-ff0b-423a-aeda-410d03b4a5d4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:17.820340 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f889c4b-ff0b-423a-aeda-410d03b4a5d4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:18.031183 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7f889c4b-ff0b-423a-aeda-410d03b4a5d4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:18.042439 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7f889c4b-ff0b-423a-aeda-410d03b4a5d4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.236569 Jul 12 17:27:18.044233 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 89/201] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:17 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:19.062551 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3683cc90-8fed-4653-aa9f-6d693dccbf69 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:19.063455 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3683cc90-8fed-4653-aa9f-6d693dccbf69 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:19.078860 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3683cc90-8fed-4653-aa9f-6d693dccbf69 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:19.079327 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3683cc90-8fed-4653-aa9f-6d693dccbf69 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:19.080106 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3683cc90-8fed-4653-aa9f-6d693dccbf69 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:19.080708 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3683cc90-8fed-4653-aa9f-6d693dccbf69 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:19.244960 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3683cc90-8fed-4653-aa9f-6d693dccbf69 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:19.254464 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3683cc90-8fed-4653-aa9f-6d693dccbf69 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.196718 Jul 12 17:27:19.255367 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 113/202] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:19 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:20.272819 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2a218570-54fa-4d64-b9a7-f834a0558e74 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:20.273497 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2a218570-54fa-4d64-b9a7-f834a0558e74 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:20.282686 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2a218570-54fa-4d64-b9a7-f834a0558e74 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:20.283547 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2a218570-54fa-4d64-b9a7-f834a0558e74 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:20.284450 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2a218570-54fa-4d64-b9a7-f834a0558e74 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:20.285811 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2a218570-54fa-4d64-b9a7-f834a0558e74 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:20.516108 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2a218570-54fa-4d64-b9a7-f834a0558e74 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:20.529164 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2a218570-54fa-4d64-b9a7-f834a0558e74 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.258239 Jul 12 17:27:20.529836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 90/203] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:20 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:21.547699 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b9a034e8-ce84-4a73-af6a-813c1c797328 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:21.548317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b9a034e8-ce84-4a73-af6a-813c1c797328 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:21.557818 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9a034e8-ce84-4a73-af6a-813c1c797328 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:21.558577 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9a034e8-ce84-4a73-af6a-813c1c797328 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:21.559922 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9a034e8-ce84-4a73-af6a-813c1c797328 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:21.561105 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9a034e8-ce84-4a73-af6a-813c1c797328 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:21.734044 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b9a034e8-ce84-4a73-af6a-813c1c797328 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:21.743197 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b9a034e8-ce84-4a73-af6a-813c1c797328 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.200258 Jul 12 17:27:21.743768 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 114/204] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:21 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:27:22.760340 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-56f8dcc2-c7a8-4582-8aa1-f41a5f32aac3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:22.762614 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-56f8dcc2-c7a8-4582-8aa1-f41a5f32aac3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:22.771677 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-56f8dcc2-c7a8-4582-8aa1-f41a5f32aac3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:22.777560 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-56f8dcc2-c7a8-4582-8aa1-f41a5f32aac3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:22.778437 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-56f8dcc2-c7a8-4582-8aa1-f41a5f32aac3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:22.778887 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-56f8dcc2-c7a8-4582-8aa1-f41a5f32aac3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:22.903792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ac415ecc-fb35-4b09-8f65-a93f2f99a7fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1093540545", "imageRef": "b19e7830-75c9-4706-bd34-4954ba6b4cc1", "flavorRef": "452"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:27:22.961899 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-ac415ecc-fb35-4b09-8f65-a93f2f99a7fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] validate_networks() for None {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:27:22.978655 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-56f8dcc2-c7a8-4582-8aa1-f41a5f32aac3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:22.990023 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-56f8dcc2-c7a8-4582-8aa1-f41a5f32aac3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.233710 Jul 12 17:27:22.990811 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 91/205] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:22 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:23.285908 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-ac415ecc-fb35-4b09-8f65-a93f2f99a7fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:27:23.286505 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-ac415ecc-fb35-4b09-8f65-a93f2f99a7fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:27:23.287133 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-ac415ecc-fb35-4b09-8f65-a93f2f99a7fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:27:23.287722 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-ac415ecc-fb35-4b09-8f65-a93f2f99a7fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:27:23.288237 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-ac415ecc-fb35-4b09-8f65-a93f2f99a7fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:27:23.298958 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ac415ecc-fb35-4b09-8f65-a93f2f99a7fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:23.299717 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ac415ecc-fb35-4b09-8f65-a93f2f99a7fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:23.300432 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ac415ecc-fb35-4b09-8f65-a93f2f99a7fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:23.301037 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ac415ecc-fb35-4b09-8f65-a93f2f99a7fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:23.318080 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-ac415ecc-fb35-4b09-8f65-a93f2f99a7fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Getting quotas for project 4c31a89a56f14fcd94b54e0d66b9c56e. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:27:23.322415 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-ac415ecc-fb35-4b09-8f65-a93f2f99a7fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Getting quotas for user a075319aaa5d4725887d2ba384277b36 and project 4c31a89a56f14fcd94b54e0d66b9c56e. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:27:23.333855 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ac415ecc-fb35-4b09-8f65-a93f2f99a7fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:27:23.336333 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ac415ecc-fb35-4b09-8f65-a93f2f99a7fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19e7830-75c9-4706-bd34-4954ba6b4cc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:27:23.403890 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ac415ecc-fb35-4b09-8f65-a93f2f99a7fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503865 Jul 12 17:27:23.404855 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 115/206] 10.222.0.62 () {60 vars in 1146 bytes} [Tue Jul 12 17:27:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 17:27:23.415391 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-de6c7f6b-99a4-43cd-9ab4-42930356af2c tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:23.416429 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-de6c7f6b-99a4-43cd-9ab4-42930356af2c tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:23.486163 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-de6c7f6b-99a4-43cd-9ab4-42930356af2c tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:23.496710 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-de6c7f6b-99a4-43cd-9ab4-42930356af2c tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1215 microversion: 2.1 time: 0.085892 Jul 12 17:27:23.497451 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 92/207] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:23 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:24.008263 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cb397375-167e-4e3b-8dbc-98c8a288324e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:24.008919 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cb397375-167e-4e3b-8dbc-98c8a288324e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:24.015967 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cb397375-167e-4e3b-8dbc-98c8a288324e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:24.016424 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cb397375-167e-4e3b-8dbc-98c8a288324e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:24.017208 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cb397375-167e-4e3b-8dbc-98c8a288324e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:24.017644 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cb397375-167e-4e3b-8dbc-98c8a288324e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:24.153480 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cb397375-167e-4e3b-8dbc-98c8a288324e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:24.161018 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cb397375-167e-4e3b-8dbc-98c8a288324e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.156796 Jul 12 17:27:24.161589 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 116/208] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:24 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:24.513668 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0876f85f-d9db-4f38-a9e9-b16c1788c47e tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:24.514347 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0876f85f-d9db-4f38-a9e9-b16c1788c47e tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:24.521138 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0876f85f-d9db-4f38-a9e9-b16c1788c47e tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:24.521588 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0876f85f-d9db-4f38-a9e9-b16c1788c47e tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:24.522382 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0876f85f-d9db-4f38-a9e9-b16c1788c47e tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:24.522814 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0876f85f-d9db-4f38-a9e9-b16c1788c47e tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:24.586078 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0876f85f-d9db-4f38-a9e9-b16c1788c47e tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:24.593785 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0876f85f-d9db-4f38-a9e9-b16c1788c47e tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1219 microversion: 2.1 time: 0.083884 Jul 12 17:27:24.594340 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 93/209] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:24 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:25.178950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-48de965b-c7b7-4435-aa85-ff7677932e45 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:25.180444 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-48de965b-c7b7-4435-aa85-ff7677932e45 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:25.188380 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-48de965b-c7b7-4435-aa85-ff7677932e45 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:25.189055 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-48de965b-c7b7-4435-aa85-ff7677932e45 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:25.190084 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-48de965b-c7b7-4435-aa85-ff7677932e45 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:25.190528 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-48de965b-c7b7-4435-aa85-ff7677932e45 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:25.348802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-48de965b-c7b7-4435-aa85-ff7677932e45 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:25.357332 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-48de965b-c7b7-4435-aa85-ff7677932e45 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.183083 Jul 12 17:27:25.358064 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 117/210] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:25 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:25.610435 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-dcc2a86b-2d7d-4d42-9b8d-2ad162c48ce7 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:25.611067 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-dcc2a86b-2d7d-4d42-9b8d-2ad162c48ce7 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:25.626981 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dcc2a86b-2d7d-4d42-9b8d-2ad162c48ce7 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:25.627439 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dcc2a86b-2d7d-4d42-9b8d-2ad162c48ce7 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:25.628225 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dcc2a86b-2d7d-4d42-9b8d-2ad162c48ce7 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:25.628693 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dcc2a86b-2d7d-4d42-9b8d-2ad162c48ce7 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:25.714954 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-dcc2a86b-2d7d-4d42-9b8d-2ad162c48ce7 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:25.723605 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-dcc2a86b-2d7d-4d42-9b8d-2ad162c48ce7 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1211 microversion: 2.1 time: 0.117571 Jul 12 17:27:25.724427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 94/211] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:25 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1211 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:26.092658 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b7ca7633-8a11-4554-b61f-f06d31dacc35 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:26.093157 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b7ca7633-8a11-4554-b61f-f06d31dacc35 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:26.099535 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7ca7633-8a11-4554-b61f-f06d31dacc35 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:26.099984 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7ca7633-8a11-4554-b61f-f06d31dacc35 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:26.100754 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7ca7633-8a11-4554-b61f-f06d31dacc35 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:26.101187 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7ca7633-8a11-4554-b61f-f06d31dacc35 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:26.132441 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b7ca7633-8a11-4554-b61f-f06d31dacc35 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:27:26.245945 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b7ca7633-8a11-4554-b61f-f06d31dacc35 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 204 len: 0 microversion: 2.1 time: 0.157370 Jul 12 17:27:26.246542 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 118/212] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:27:26 2022] DELETE /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:27:26.255400 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b12d558d-432f-4057-8262-5e22129a48fc tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:26.256009 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b12d558d-432f-4057-8262-5e22129a48fc tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:26.262995 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b12d558d-432f-4057-8262-5e22129a48fc tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:26.263852 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b12d558d-432f-4057-8262-5e22129a48fc tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:26.264791 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b12d558d-432f-4057-8262-5e22129a48fc tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:26.265217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b12d558d-432f-4057-8262-5e22129a48fc tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:26.377529 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-43a5e590-dd87-4d65-bdba-6357be9b6204 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:26.378345 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-43a5e590-dd87-4d65-bdba-6357be9b6204 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:26.384529 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-43a5e590-dd87-4d65-bdba-6357be9b6204 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:26.385268 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-43a5e590-dd87-4d65-bdba-6357be9b6204 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:26.386300 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-43a5e590-dd87-4d65-bdba-6357be9b6204 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:26.386970 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-43a5e590-dd87-4d65-bdba-6357be9b6204 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:26.438868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b12d558d-432f-4057-8262-5e22129a48fc tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:26.447235 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b12d558d-432f-4057-8262-5e22129a48fc tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1552 microversion: 2.1 time: 0.196001 Jul 12 17:27:26.448334 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 95/213] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:26 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1552 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:26.572498 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-43a5e590-dd87-4d65-bdba-6357be9b6204 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:26.581950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-43a5e590-dd87-4d65-bdba-6357be9b6204 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.208589 Jul 12 17:27:26.582543 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 119/214] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:26 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:27:26.740724 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2e3cf7de-bb99-4184-a309-206b4a6448ea tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:26.741838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2e3cf7de-bb99-4184-a309-206b4a6448ea tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:26.748766 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2e3cf7de-bb99-4184-a309-206b4a6448ea tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:26.749287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2e3cf7de-bb99-4184-a309-206b4a6448ea tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:26.750151 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2e3cf7de-bb99-4184-a309-206b4a6448ea tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:26.750889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2e3cf7de-bb99-4184-a309-206b4a6448ea tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:26.819656 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2e3cf7de-bb99-4184-a309-206b4a6448ea tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:26.829160 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2e3cf7de-bb99-4184-a309-206b4a6448ea tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1275 microversion: 2.1 time: 0.092248 Jul 12 17:27:26.829878 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 96/215] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:26 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1275 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:27.464562 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c705ead6-2866-4ddd-a8ad-656e7df887e6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:27.465841 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c705ead6-2866-4ddd-a8ad-656e7df887e6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:27.472491 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c705ead6-2866-4ddd-a8ad-656e7df887e6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:27.472934 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c705ead6-2866-4ddd-a8ad-656e7df887e6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:27.474130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c705ead6-2866-4ddd-a8ad-656e7df887e6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:27.474722 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c705ead6-2866-4ddd-a8ad-656e7df887e6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:27.602165 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1beffa9a-884c-4305-bc58-4ed6bcae35bb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:27.603145 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1beffa9a-884c-4305-bc58-4ed6bcae35bb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:27.612376 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1beffa9a-884c-4305-bc58-4ed6bcae35bb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:27.613495 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1beffa9a-884c-4305-bc58-4ed6bcae35bb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:27.614575 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1beffa9a-884c-4305-bc58-4ed6bcae35bb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:27.615181 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1beffa9a-884c-4305-bc58-4ed6bcae35bb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:28.110962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c705ead6-2866-4ddd-a8ad-656e7df887e6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:28.119492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c705ead6-2866-4ddd-a8ad-656e7df887e6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1552 microversion: 2.1 time: 0.658762 Jul 12 17:27:28.120549 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 120/216] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:27 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1552 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:28.126431 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4d2d12d6-1715-4415-82da-d79e40161f7c tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:28.127225 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4d2d12d6-1715-4415-82da-d79e40161f7c tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:28.133877 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1beffa9a-884c-4305-bc58-4ed6bcae35bb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:28.144449 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4d2d12d6-1715-4415-82da-d79e40161f7c tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:28.144629 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1beffa9a-884c-4305-bc58-4ed6bcae35bb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.547937 Jul 12 17:27:28.144964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4d2d12d6-1715-4415-82da-d79e40161f7c tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:28.145437 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 97/217] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:27 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:27:28.154965 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4d2d12d6-1715-4415-82da-d79e40161f7c tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:28.155770 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4d2d12d6-1715-4415-82da-d79e40161f7c tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:28.284685 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4d2d12d6-1715-4415-82da-d79e40161f7c tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:28.292613 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4d2d12d6-1715-4415-82da-d79e40161f7c tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1275 microversion: 2.1 time: 0.170873 Jul 12 17:27:28.303711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 121/218] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:28 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1275 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:29.143325 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f520c294-5e2b-490b-9c43-fd40d60b2d8d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:29.145400 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f520c294-5e2b-490b-9c43-fd40d60b2d8d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:29.158931 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f520c294-5e2b-490b-9c43-fd40d60b2d8d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:29.160274 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f520c294-5e2b-490b-9c43-fd40d60b2d8d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:29.161384 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a08e57ff-3f1b-403b-836e-0ad411a635be tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:29.162949 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f520c294-5e2b-490b-9c43-fd40d60b2d8d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:29.163634 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f520c294-5e2b-490b-9c43-fd40d60b2d8d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:29.165884 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a08e57ff-3f1b-403b-836e-0ad411a635be tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:29.184717 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a08e57ff-3f1b-403b-836e-0ad411a635be tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:29.185598 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a08e57ff-3f1b-403b-836e-0ad411a635be tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:29.186454 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a08e57ff-3f1b-403b-836e-0ad411a635be tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:29.193180 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a08e57ff-3f1b-403b-836e-0ad411a635be tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:29.243978 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:29.593146 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f520c294-5e2b-490b-9c43-fd40d60b2d8d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:29.605070 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f520c294-5e2b-490b-9c43-fd40d60b2d8d tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1552 microversion: 2.1 time: 0.471170 Jul 12 17:27:29.605972 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 98/219] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:29 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1552 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:29.613639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a08e57ff-3f1b-403b-836e-0ad411a635be tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:29.614992 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-bc8f6924-2c11-4398-99d2-e90f3ad75861 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:29.615715 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-bc8f6924-2c11-4398-99d2-e90f3ad75861 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:29.626086 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a08e57ff-3f1b-403b-836e-0ad411a635be tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.468282 Jul 12 17:27:29.626688 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 122/220] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:29 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:29.643541 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bc8f6924-2c11-4398-99d2-e90f3ad75861 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:29.643997 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bc8f6924-2c11-4398-99d2-e90f3ad75861 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:29.647539 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bc8f6924-2c11-4398-99d2-e90f3ad75861 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:29.647995 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bc8f6924-2c11-4398-99d2-e90f3ad75861 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:29.781828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-bc8f6924-2c11-4398-99d2-e90f3ad75861 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:29.790905 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-bc8f6924-2c11-4398-99d2-e90f3ad75861 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1273 microversion: 2.1 time: 0.179933 Jul 12 17:27:29.792524 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 99/221] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:29 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1273 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:30.622200 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-56373d98-de61-43d3-a9d2-9745d1fea0b3 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:30.622847 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-56373d98-de61-43d3-a9d2-9745d1fea0b3 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:30.643925 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6c637815-56d7-46ea-ad0a-3a8d63f802b5 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:30.644528 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6c637815-56d7-46ea-ad0a-3a8d63f802b5 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:30.649871 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-56373d98-de61-43d3-a9d2-9745d1fea0b3 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:30.650330 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-56373d98-de61-43d3-a9d2-9745d1fea0b3 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:30.651132 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-56373d98-de61-43d3-a9d2-9745d1fea0b3 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:30.651596 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-56373d98-de61-43d3-a9d2-9745d1fea0b3 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:30.655280 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6c637815-56d7-46ea-ad0a-3a8d63f802b5 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:30.658748 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6c637815-56d7-46ea-ad0a-3a8d63f802b5 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:30.660346 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6c637815-56d7-46ea-ad0a-3a8d63f802b5 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:30.662490 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6c637815-56d7-46ea-ad0a-3a8d63f802b5 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:31.199492 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6c637815-56d7-46ea-ad0a-3a8d63f802b5 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:31.219441 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6c637815-56d7-46ea-ad0a-3a8d63f802b5 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.578223 Jul 12 17:27:31.220048 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 100/222] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:30 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:27:31.221927 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-56373d98-de61-43d3-a9d2-9745d1fea0b3 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:31.233947 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-efc8ec04-cb1b-47ee-8195-10d51665e6fb tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:31.236534 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-efc8ec04-cb1b-47ee-8195-10d51665e6fb tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:31.261627 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-56373d98-de61-43d3-a9d2-9745d1fea0b3 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1552 microversion: 2.1 time: 0.638326 Jul 12 17:27:31.264012 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-efc8ec04-cb1b-47ee-8195-10d51665e6fb tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:31.264603 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 123/223] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:30 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1552 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:31.266124 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-efc8ec04-cb1b-47ee-8195-10d51665e6fb tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:31.268382 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-efc8ec04-cb1b-47ee-8195-10d51665e6fb tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:31.268978 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-efc8ec04-cb1b-47ee-8195-10d51665e6fb tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:31.296536 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-d16264cb-ec09-482e-8f8f-feeba1267ad0 req-0a87ac34-707b-4d94-ad7b-f097c1f0c385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec1a3e3c-1467-458b-ace6-0ff381218e4a", "name": "network-vif-deleted", "tag": "7fe73886-acc0-410d-b06c-1db1396a9c76"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:27:31.334068 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-d16264cb-ec09-482e-8f8f-feeba1267ad0 req-0a87ac34-707b-4d94-ad7b-f097c1f0c385 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:31.339761 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-d16264cb-ec09-482e-8f8f-feeba1267ad0 req-0a87ac34-707b-4d94-ad7b-f097c1f0c385 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:31.371335 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-d16264cb-ec09-482e-8f8f-feeba1267ad0 req-0a87ac34-707b-4d94-ad7b-f097c1f0c385 service nova] Creating event network-vif-deleted:7fe73886-acc0-410d-b06c-1db1396a9c76 for instance ec1a3e3c-1467-458b-ace6-0ff381218e4a on hv-cinder-84932 Jul 12 17:27:31.381915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-d16264cb-ec09-482e-8f8f-feeba1267ad0 req-0a87ac34-707b-4d94-ad7b-f097c1f0c385 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115761 Jul 12 17:27:31.386091 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 124/224] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:27:31.918322 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-efc8ec04-cb1b-47ee-8195-10d51665e6fb tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:31.927102 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-efc8ec04-cb1b-47ee-8195-10d51665e6fb tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1315 microversion: 2.1 time: 0.704679 Jul 12 17:27:31.927861 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 101/225] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:31 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1315 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:32.206229 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-7b625077-a9cd-4d6b-bf7a-40eadb3c19e4 req-35f0c5e3-3234-426e-b989-bbb54d463e57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "491bc7de-097a-41df-a049-3dffa6008626", "tag": "0ddce34f-f407-4b2c-b2d1-7b334aded8ba"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:27:32.210216 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:32.220955 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-7b625077-a9cd-4d6b-bf7a-40eadb3c19e4 req-35f0c5e3-3234-426e-b989-bbb54d463e57 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:32.221402 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-7b625077-a9cd-4d6b-bf7a-40eadb3c19e4 req-35f0c5e3-3234-426e-b989-bbb54d463e57 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:32.237334 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-261ab99c-5728-450a-9ecc-f1a9c29fa398 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:32.238133 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-261ab99c-5728-450a-9ecc-f1a9c29fa398 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:32.254986 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-261ab99c-5728-450a-9ecc-f1a9c29fa398 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:32.255455 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-261ab99c-5728-450a-9ecc-f1a9c29fa398 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:32.256262 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-261ab99c-5728-450a-9ecc-f1a9c29fa398 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:32.256702 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-261ab99c-5728-450a-9ecc-f1a9c29fa398 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:32.279908 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-7b625077-a9cd-4d6b-bf7a-40eadb3c19e4 req-35f0c5e3-3234-426e-b989-bbb54d463e57 service nova] Creating event network-changed:0ddce34f-f407-4b2c-b2d1-7b334aded8ba for instance 491bc7de-097a-41df-a049-3dffa6008626 on hv-cinder-84932 Jul 12 17:27:32.313204 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-7b625077-a9cd-4d6b-bf7a-40eadb3c19e4 req-35f0c5e3-3234-426e-b989-bbb54d463e57 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111048 Jul 12 17:27:32.314528 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 125/226] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:27:32.328707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e797c757-a675-43ca-a4e0-7e1a7fc42c72 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:32.329754 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e797c757-a675-43ca-a4e0-7e1a7fc42c72 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:32.362496 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e797c757-a675-43ca-a4e0-7e1a7fc42c72 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:32.363870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e797c757-a675-43ca-a4e0-7e1a7fc42c72 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:32.364907 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e797c757-a675-43ca-a4e0-7e1a7fc42c72 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:32.365532 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e797c757-a675-43ca-a4e0-7e1a7fc42c72 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:32.433239 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e797c757-a675-43ca-a4e0-7e1a7fc42c72 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:32.438010 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e797c757-a675-43ca-a4e0-7e1a7fc42c72 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:32.438662 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-e797c757-a675-43ca-a4e0-7e1a7fc42c72 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lazy-loading 'fault' on Instance uuid ec1a3e3c-1467-458b-ace6-0ff381218e4a {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:27:32.539343 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e797c757-a675-43ca-a4e0-7e1a7fc42c72 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad21d1c348f49c5b74c1e27efdf58b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac7ab2675b74a88bc33a21ffbc31586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:32.554470 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e797c757-a675-43ca-a4e0-7e1a7fc42c72 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 200 len: 1349 microversion: 2.1 time: 0.234945 Jul 12 17:27:32.555448 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 126/227] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:32 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 1349 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:32.754151 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-261ab99c-5728-450a-9ecc-f1a9c29fa398 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:32.762710 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-261ab99c-5728-450a-9ecc-f1a9c29fa398 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.530388 Jul 12 17:27:32.763386 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 102/228] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:32 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:27:32.946837 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-aaaac8f1-a6a4-4865-ad5e-d0d1eeec4a93 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:32.947426 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-aaaac8f1-a6a4-4865-ad5e-d0d1eeec4a93 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:32.957433 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aaaac8f1-a6a4-4865-ad5e-d0d1eeec4a93 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:32.957927 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aaaac8f1-a6a4-4865-ad5e-d0d1eeec4a93 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:32.958724 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aaaac8f1-a6a4-4865-ad5e-d0d1eeec4a93 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:32.959170 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aaaac8f1-a6a4-4865-ad5e-d0d1eeec4a93 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:33.309061 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:33.329293 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:33.342508 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-aaaac8f1-a6a4-4865-ad5e-d0d1eeec4a93 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:33.353624 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-aaaac8f1-a6a4-4865-ad5e-d0d1eeec4a93 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1315 microversion: 2.1 time: 0.412195 Jul 12 17:27:33.354532 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 127/229] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:32 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:33.573403 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d483da05-5006-4411-896d-1a7e2ade063f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:33.574319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d483da05-5006-4411-896d-1a7e2ade063f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:33.577087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:33.578105 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=50 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:33.589327 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d483da05-5006-4411-896d-1a7e2ade063f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:33.592534 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d483da05-5006-4411-896d-1a7e2ade063f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:33.593969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d483da05-5006-4411-896d-1a7e2ade063f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:33.594855 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d483da05-5006-4411-896d-1a7e2ade063f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:33.637672 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-d483da05-5006-4411-896d-1a7e2ade063f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] HTTP exception thrown: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. Jul 12 17:27:33.649771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d483da05-5006-4411-896d-1a7e2ade063f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Request method failure captured: Jul 12 17:27:33.649771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a HTTP/1.1 Jul 12 17:27:33.649771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:27:33.649771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:27:33.649771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:27:33.649771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:27:33.649771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:27:33.649771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:27:33.649771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:27:33.649771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:27:33.649771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza6pPPJ-fvM04YNbwPsnhIPGBnWGRmQSjVDe_K3p7Prik7oO4ChVtMWg4vi7vAU7qJmnUitJ0LE1TaCH8tGu1G-IlAMcEdS8oD5vpmXRz-adg-GUerF0zA3Q5W0EaOv4ZZ8x4HxAI8nV1kv693wxmuYf-QpBB-lUa6LwSnSZojm-pYg Jul 12 17:27:33.649771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:27:33.649771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:27:33.649771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:27:33.649771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:27:33.649771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:27:33.649771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:27:33.649771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: fac7ab2675b74a88bc33a21ffbc31586 Jul 12 17:27:33.649771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-DeleteServersTestJSON-1316098160 Jul 12 17:27:33.649771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:27:33.649771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:27:33.651014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fac7ab2675b74a88bc33a21ffbc31586"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fac7ab2675b74a88bc33a21ffbc31586"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fac7ab2675b74a88bc33a21ffbc31586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fac7ab2675b74a88bc33a21ffbc31586", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:27:33.651014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-DeleteServersTestJSON-1316098160 Jul 12 17:27:33.651014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: fac7ab2675b74a88bc33a21ffbc31586 Jul 12 17:27:33.651014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-DeleteServersTestJSON-1316098160 Jul 12 17:27:33.651014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-DeleteServersTestJSON-1316098160-project Jul 12 17:27:33.651014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:27:33.651014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:27:33.651014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: 0ad21d1c348f49c5b74c1e27efdf58b1 Jul 12 17:27:33.651014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-DeleteServersTestJSON-1316098160-project Jul 12 17:27:33.651014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:27:33.651014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. Jul 12 17:27:33.651014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': 'ec1a3e3c-1467-458b-ace6-0ff381218e4a'} Jul 12 17:27:33.651914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:27:33.651914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:27:33.651914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:27:33.651914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:27:33.651914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:27:33.651914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:27:33.651914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:27:33.651914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:27:33.651914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:27:33.651914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:27:33.651914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. Jul 12 17:27:33.651914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:33.651914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:27:33.651914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:33.651914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:27:33.651914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:27:33.651914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:27:33.651914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:27:33.651914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:27:33.651914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:27:33.653050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:27:33.653050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:27:33.653050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:27:33.653050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:27:33.653050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:27:33.653050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:27:33.653050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:27:33.653050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. Jul 12 17:27:33.653050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:33.653050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:27:33.653050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:33.653050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:27:33.653050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:27:33.653050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:27:33.653050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:27:33.653050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:27:33.653050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. Jul 12 17:27:33.653050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:33.656412 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d483da05-5006-4411-896d-1a7e2ade063f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Returning 404 to user: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:27:33.657796 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d483da05-5006-4411-896d-1a7e2ade063f tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 404 len: 111 microversion: 2.1 time: 0.088277 Jul 12 17:27:33.662170 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 103/230] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:33 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:27:33.783494 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-03dc6863-6013-4304-a125-3e9222f17532 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:33.784115 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-03dc6863-6013-4304-a125-3e9222f17532 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:33.788247 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4f0a8d4e-363f-46bc-8dc2-da9d1ea8fda6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:33.789496 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4f0a8d4e-363f-46bc-8dc2-da9d1ea8fda6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:33.792015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-03dc6863-6013-4304-a125-3e9222f17532 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:33.792686 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-03dc6863-6013-4304-a125-3e9222f17532 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:33.793662 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-03dc6863-6013-4304-a125-3e9222f17532 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:33.794290 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-03dc6863-6013-4304-a125-3e9222f17532 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:33.802548 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4f0a8d4e-363f-46bc-8dc2-da9d1ea8fda6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:33.803011 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4f0a8d4e-363f-46bc-8dc2-da9d1ea8fda6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:33.804201 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4f0a8d4e-363f-46bc-8dc2-da9d1ea8fda6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:33.805564 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4f0a8d4e-363f-46bc-8dc2-da9d1ea8fda6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:33.837501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-4f0a8d4e-363f-46bc-8dc2-da9d1ea8fda6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] HTTP exception thrown: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. Jul 12 17:27:33.840608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4f0a8d4e-363f-46bc-8dc2-da9d1ea8fda6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Request method failure captured: Jul 12 17:27:33.840608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a/os-volume_attachments HTTP/1.1 Jul 12 17:27:33.840608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:27:33.840608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:27:33.840608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:27:33.840608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:27:33.840608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:27:33.840608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:27:33.840608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:27:33.840608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:27:33.840608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza6pPPJ-fvM04YNbwPsnhIPGBnWGRmQSjVDe_K3p7Prik7oO4ChVtMWg4vi7vAU7qJmnUitJ0LE1TaCH8tGu1G-IlAMcEdS8oD5vpmXRz-adg-GUerF0zA3Q5W0EaOv4ZZ8x4HxAI8nV1kv693wxmuYf-QpBB-lUa6LwSnSZojm-pYg Jul 12 17:27:33.840608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:27:33.840608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:27:33.840608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:27:33.840608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:27:33.840608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:27:33.840608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:27:33.840608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: fac7ab2675b74a88bc33a21ffbc31586 Jul 12 17:27:33.840608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-DeleteServersTestJSON-1316098160 Jul 12 17:27:33.840608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:27:33.840608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:27:33.842641 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fac7ab2675b74a88bc33a21ffbc31586"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fac7ab2675b74a88bc33a21ffbc31586"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fac7ab2675b74a88bc33a21ffbc31586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fac7ab2675b74a88bc33a21ffbc31586", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:27:33.842641 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-DeleteServersTestJSON-1316098160 Jul 12 17:27:33.842641 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: fac7ab2675b74a88bc33a21ffbc31586 Jul 12 17:27:33.842641 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-DeleteServersTestJSON-1316098160 Jul 12 17:27:33.842641 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-DeleteServersTestJSON-1316098160-project Jul 12 17:27:33.842641 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:27:33.842641 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:27:33.842641 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: 0ad21d1c348f49c5b74c1e27efdf58b1 Jul 12 17:27:33.842641 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-DeleteServersTestJSON-1316098160-project Jul 12 17:27:33.842641 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:27:33.842641 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. Jul 12 17:27:33.842641 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'server_id': 'ec1a3e3c-1467-458b-ace6-0ff381218e4a'} Jul 12 17:27:33.843484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:27:33.843484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:27:33.843484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:27:33.843484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:27:33.843484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:27:33.843484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:27:33.843484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:27:33.843484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:27:33.843484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:27:33.843484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:27:33.843484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. Jul 12 17:27:33.843484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:33.843484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:27:33.843484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:33.843484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:27:33.843484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:27:33.843484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:27:33.843484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:27:33.843484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:27:33.843484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:27:33.844818 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:27:33.844818 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 17:27:33.844818 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:27:33.844818 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 17:27:33.844818 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:27:33.844818 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 12 17:27:33.844818 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 12 17:27:33.844818 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:27:33.844818 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:27:33.844818 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. Jul 12 17:27:33.844818 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:33.844818 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:27:33.844818 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:33.844818 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:27:33.844818 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:27:33.844818 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:27:33.844818 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:27:33.844818 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:27:33.844818 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. Jul 12 17:27:33.844818 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:33.848278 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4f0a8d4e-363f-46bc-8dc2-da9d1ea8fda6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Returning 404 to user: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:27:33.850049 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4f0a8d4e-363f-46bc-8dc2-da9d1ea8fda6 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.068839 Jul 12 17:27:33.850953 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 104/231] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:27:33 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a/os-volume_attachments => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:27:34.028361 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-03dc6863-6013-4304-a125-3e9222f17532 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:34.047243 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-03dc6863-6013-4304-a125-3e9222f17532 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.268156 Jul 12 17:27:34.050469 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 128/232] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:33 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:34.370289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3dabebe4-00ee-46da-b767-d14d1467fadc tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:34.371051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3dabebe4-00ee-46da-b767-d14d1467fadc tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:34.382926 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3dabebe4-00ee-46da-b767-d14d1467fadc tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:34.383497 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3dabebe4-00ee-46da-b767-d14d1467fadc tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:34.386124 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3dabebe4-00ee-46da-b767-d14d1467fadc tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:34.387767 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3dabebe4-00ee-46da-b767-d14d1467fadc tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:34.778436 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3dabebe4-00ee-46da-b767-d14d1467fadc tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:34.787267 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3dabebe4-00ee-46da-b767-d14d1467fadc tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1315 microversion: 2.1 time: 0.420067 Jul 12 17:27:34.788643 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 105/233] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:34 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:35.071694 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-51030975-7aa6-415e-8955-6bb7b14289e3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:35.072541 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-51030975-7aa6-415e-8955-6bb7b14289e3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:35.084618 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-51030975-7aa6-415e-8955-6bb7b14289e3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:35.085379 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-51030975-7aa6-415e-8955-6bb7b14289e3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:35.090248 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-51030975-7aa6-415e-8955-6bb7b14289e3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:35.091366 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-51030975-7aa6-415e-8955-6bb7b14289e3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:35.132552 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d5931a90-2b00-4f65-ac85-339e3a79fff7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:35.133124 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d5931a90-2b00-4f65-ac85-339e3a79fff7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:35.146963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d5931a90-2b00-4f65-ac85-339e3a79fff7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:35.147872 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d5931a90-2b00-4f65-ac85-339e3a79fff7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:35.148984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d5931a90-2b00-4f65-ac85-339e3a79fff7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:35.149634 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d5931a90-2b00-4f65-ac85-339e3a79fff7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:35.215354 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-d5931a90-2b00-4f65-ac85-339e3a79fff7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] HTTP exception thrown: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. Jul 12 17:27:35.220682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d5931a90-2b00-4f65-ac85-339e3a79fff7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Request method failure captured: Jul 12 17:27:35.220682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: DELETE /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a HTTP/1.1 Jul 12 17:27:35.220682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:27:35.220682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:27:35.220682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:27:35.220682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:27:35.220682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:27:35.220682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:27:35.220682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:27:35.220682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:27:35.220682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza6pPPJ-fvM04YNbwPsnhIPGBnWGRmQSjVDe_K3p7Prik7oO4ChVtMWg4vi7vAU7qJmnUitJ0LE1TaCH8tGu1G-IlAMcEdS8oD5vpmXRz-adg-GUerF0zA3Q5W0EaOv4ZZ8x4HxAI8nV1kv693wxmuYf-QpBB-lUa6LwSnSZojm-pYg Jul 12 17:27:35.220682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:27:35.220682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:27:35.220682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:27:35.220682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:27:35.220682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:27:35.220682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:27:35.220682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: fac7ab2675b74a88bc33a21ffbc31586 Jul 12 17:27:35.220682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-DeleteServersTestJSON-1316098160 Jul 12 17:27:35.220682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:27:35.220682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:27:35.222076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fac7ab2675b74a88bc33a21ffbc31586"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fac7ab2675b74a88bc33a21ffbc31586"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fac7ab2675b74a88bc33a21ffbc31586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fac7ab2675b74a88bc33a21ffbc31586", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:27:35.222076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-DeleteServersTestJSON-1316098160 Jul 12 17:27:35.222076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: fac7ab2675b74a88bc33a21ffbc31586 Jul 12 17:27:35.222076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-DeleteServersTestJSON-1316098160 Jul 12 17:27:35.222076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-DeleteServersTestJSON-1316098160-project Jul 12 17:27:35.222076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:27:35.222076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:27:35.222076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: 0ad21d1c348f49c5b74c1e27efdf58b1 Jul 12 17:27:35.222076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-DeleteServersTestJSON-1316098160-project Jul 12 17:27:35.222076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:27:35.222076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. Jul 12 17:27:35.222076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': 'ec1a3e3c-1467-458b-ace6-0ff381218e4a'} Jul 12 17:27:35.222906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:27:35.222906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:27:35.222906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:27:35.222906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:27:35.222906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:27:35.222906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:27:35.222906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:27:35.222906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:27:35.222906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:27:35.222906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:27:35.222906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. Jul 12 17:27:35.222906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:35.222906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:27:35.222906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:35.222906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:27:35.222906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:27:35.222906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:27:35.222906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:27:35.222906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:27:35.222906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:27:35.224214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:27:35.224214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 17:27:35.224214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 17:27:35.224214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 17:27:35.224214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 17:27:35.224214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:27:35.224214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:27:35.224214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:27:35.224214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:27:35.224214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. Jul 12 17:27:35.224214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:35.224214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:27:35.224214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:35.224214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:27:35.224214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:27:35.224214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:27:35.224214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:27:35.224214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:27:35.224214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. Jul 12 17:27:35.224214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:35.226911 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d5931a90-2b00-4f65-ac85-339e3a79fff7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Returning 404 to user: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:27:35.228552 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d5931a90-2b00-4f65-ac85-339e3a79fff7 tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 404 len: 111 microversion: 2.1 time: 0.101117 Jul 12 17:27:35.229828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 106/234] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:27:35 2022] DELETE /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:27:35.251454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-fc62f515-14a6-44b8-a5b6-ae00a0edd33b tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:35.254897 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-fc62f515-14a6-44b8-a5b6-ae00a0edd33b tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] [instance: ec1a3e3c-1467-458b-ace6-0ff381218e4a] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:35.264729 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fc62f515-14a6-44b8-a5b6-ae00a0edd33b tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:35.265881 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fc62f515-14a6-44b8-a5b6-ae00a0edd33b tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:35.266975 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fc62f515-14a6-44b8-a5b6-ae00a0edd33b tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:35.267614 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fc62f515-14a6-44b8-a5b6-ae00a0edd33b tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:35.286739 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-fc62f515-14a6-44b8-a5b6-ae00a0edd33b tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] HTTP exception thrown: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. Jul 12 17:27:35.288717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-fc62f515-14a6-44b8-a5b6-ae00a0edd33b tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Request method failure captured: Jul 12 17:27:35.288717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a HTTP/1.1 Jul 12 17:27:35.288717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:27:35.288717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:27:35.288717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:27:35.288717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:27:35.288717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:27:35.288717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:27:35.288717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:27:35.288717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:27:35.288717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza6pPPJ-fvM04YNbwPsnhIPGBnWGRmQSjVDe_K3p7Prik7oO4ChVtMWg4vi7vAU7qJmnUitJ0LE1TaCH8tGu1G-IlAMcEdS8oD5vpmXRz-adg-GUerF0zA3Q5W0EaOv4ZZ8x4HxAI8nV1kv693wxmuYf-QpBB-lUa6LwSnSZojm-pYg Jul 12 17:27:35.288717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:27:35.288717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:27:35.288717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:27:35.288717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:27:35.288717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:27:35.288717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:27:35.288717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: fac7ab2675b74a88bc33a21ffbc31586 Jul 12 17:27:35.288717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-DeleteServersTestJSON-1316098160 Jul 12 17:27:35.288717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:27:35.288717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:27:35.290315 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fac7ab2675b74a88bc33a21ffbc31586"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fac7ab2675b74a88bc33a21ffbc31586"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fac7ab2675b74a88bc33a21ffbc31586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fac7ab2675b74a88bc33a21ffbc31586", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:27:35.290315 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-DeleteServersTestJSON-1316098160 Jul 12 17:27:35.290315 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: fac7ab2675b74a88bc33a21ffbc31586 Jul 12 17:27:35.290315 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-DeleteServersTestJSON-1316098160 Jul 12 17:27:35.290315 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-DeleteServersTestJSON-1316098160-project Jul 12 17:27:35.290315 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:27:35.290315 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:27:35.290315 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: 0ad21d1c348f49c5b74c1e27efdf58b1 Jul 12 17:27:35.290315 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-DeleteServersTestJSON-1316098160-project Jul 12 17:27:35.290315 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:27:35.290315 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. Jul 12 17:27:35.290315 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': 'ec1a3e3c-1467-458b-ace6-0ff381218e4a'} Jul 12 17:27:35.291004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:27:35.291004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:27:35.291004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:27:35.291004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:27:35.291004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:27:35.291004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:27:35.291004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:27:35.291004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:27:35.291004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:27:35.291004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:27:35.291004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. Jul 12 17:27:35.291004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:35.291004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:27:35.291004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:35.291004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:27:35.291004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:27:35.291004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:27:35.291004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:27:35.291004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:27:35.291004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:27:35.292077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:27:35.292077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:27:35.292077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:27:35.292077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:27:35.292077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:27:35.292077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:27:35.292077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:27:35.292077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. Jul 12 17:27:35.292077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:35.292077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:27:35.292077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:35.292077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:27:35.292077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:27:35.292077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:27:35.292077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:27:35.292077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:27:35.292077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. Jul 12 17:27:35.292077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:35.295508 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-fc62f515-14a6-44b8-a5b6-ae00a0edd33b tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] Returning 404 to user: Instance ec1a3e3c-1467-458b-ace6-0ff381218e4a could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:27:35.296419 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-fc62f515-14a6-44b8-a5b6-ae00a0edd33b tempest-DeleteServersTestJSON-1316098160 tempest-DeleteServersTestJSON-1316098160-project] 10.222.0.62 "GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a" status: 404 len: 111 microversion: 2.1 time: 0.061650 Jul 12 17:27:35.297223 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 107/235] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:35 2022] GET /compute/v2.1/servers/ec1a3e3c-1467-458b-ace6-0ff381218e4a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:27:35.336076 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-51030975-7aa6-415e-8955-6bb7b14289e3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:35.347179 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-51030975-7aa6-415e-8955-6bb7b14289e3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.283814 Jul 12 17:27:35.347770 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 129/236] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:35 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:35.817246 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1b41b5a3-7d72-48ba-bb1e-0dc1ea1d214b tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:35.819755 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1b41b5a3-7d72-48ba-bb1e-0dc1ea1d214b tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:35.828850 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1b41b5a3-7d72-48ba-bb1e-0dc1ea1d214b tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:35.830055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1b41b5a3-7d72-48ba-bb1e-0dc1ea1d214b tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:35.831090 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1b41b5a3-7d72-48ba-bb1e-0dc1ea1d214b tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:35.831754 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1b41b5a3-7d72-48ba-bb1e-0dc1ea1d214b tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:35.855845 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:36.340026 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1b41b5a3-7d72-48ba-bb1e-0dc1ea1d214b tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:36.348777 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1b41b5a3-7d72-48ba-bb1e-0dc1ea1d214b tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1315 microversion: 2.1 time: 0.543541 Jul 12 17:27:36.349565 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 108/237] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:35 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:36.373298 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5ed26452-993a-4523-addd-06519fc8dc3b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:36.375227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5ed26452-993a-4523-addd-06519fc8dc3b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:36.389915 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ed26452-993a-4523-addd-06519fc8dc3b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:36.390446 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ed26452-993a-4523-addd-06519fc8dc3b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:36.391226 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ed26452-993a-4523-addd-06519fc8dc3b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:36.399700 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5ed26452-993a-4523-addd-06519fc8dc3b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:36.640628 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5ed26452-993a-4523-addd-06519fc8dc3b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:36.649721 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5ed26452-993a-4523-addd-06519fc8dc3b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.289393 Jul 12 17:27:36.652204 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 130/238] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:36 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:37.375580 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a946598b-747c-4c8e-9b97-63d0c0b99215 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:37.378036 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a946598b-747c-4c8e-9b97-63d0c0b99215 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:37.406082 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a946598b-747c-4c8e-9b97-63d0c0b99215 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:37.409487 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a946598b-747c-4c8e-9b97-63d0c0b99215 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:37.411338 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a946598b-747c-4c8e-9b97-63d0c0b99215 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:37.412815 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a946598b-747c-4c8e-9b97-63d0c0b99215 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:37.676580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-34210745-34fc-4371-9359-e54e7a767609 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:37.677312 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-34210745-34fc-4371-9359-e54e7a767609 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:37.687596 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-34210745-34fc-4371-9359-e54e7a767609 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:37.688182 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-34210745-34fc-4371-9359-e54e7a767609 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:37.690197 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-34210745-34fc-4371-9359-e54e7a767609 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:37.692397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-34210745-34fc-4371-9359-e54e7a767609 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:37.757019 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a946598b-747c-4c8e-9b97-63d0c0b99215 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:37.773308 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a946598b-747c-4c8e-9b97-63d0c0b99215 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1315 microversion: 2.1 time: 0.410244 Jul 12 17:27:37.774473 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 109/239] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:37 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:37.870201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-34210745-34fc-4371-9359-e54e7a767609 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:37.878888 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-34210745-34fc-4371-9359-e54e7a767609 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.216060 Jul 12 17:27:37.879610 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 131/240] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:37 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:27:38.791309 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cfa3df1c-9c70-486f-9413-bb82149afa9b tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:38.792116 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-cfa3df1c-9c70-486f-9413-bb82149afa9b tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:38.805490 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cfa3df1c-9c70-486f-9413-bb82149afa9b tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:38.806760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cfa3df1c-9c70-486f-9413-bb82149afa9b tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:38.810420 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cfa3df1c-9c70-486f-9413-bb82149afa9b tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:38.811293 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cfa3df1c-9c70-486f-9413-bb82149afa9b tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:38.897022 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8407c5ad-ba43-4581-88c0-d0059eb0a469 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:38.900691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8407c5ad-ba43-4581-88c0-d0059eb0a469 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:38.917228 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8407c5ad-ba43-4581-88c0-d0059eb0a469 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:38.918023 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8407c5ad-ba43-4581-88c0-d0059eb0a469 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:38.919569 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8407c5ad-ba43-4581-88c0-d0059eb0a469 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:38.920400 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8407c5ad-ba43-4581-88c0-d0059eb0a469 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:39.094098 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cfa3df1c-9c70-486f-9413-bb82149afa9b tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:39.117439 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-cfa3df1c-9c70-486f-9413-bb82149afa9b tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1315 microversion: 2.1 time: 0.330714 Jul 12 17:27:39.118290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 110/241] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:38 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:39.364112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8407c5ad-ba43-4581-88c0-d0059eb0a469 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:39.382233 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8407c5ad-ba43-4581-88c0-d0059eb0a469 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.489929 Jul 12 17:27:39.396542 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 132/242] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:38 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:40.135788 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2c2300e0-ab3d-4b85-ae71-4827347d79ec tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:40.136387 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2c2300e0-ab3d-4b85-ae71-4827347d79ec tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:40.143535 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c2300e0-ab3d-4b85-ae71-4827347d79ec tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:40.144027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c2300e0-ab3d-4b85-ae71-4827347d79ec tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:40.145505 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c2300e0-ab3d-4b85-ae71-4827347d79ec tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:40.146511 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c2300e0-ab3d-4b85-ae71-4827347d79ec tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:40.345983 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2c2300e0-ab3d-4b85-ae71-4827347d79ec tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:40.356150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2c2300e0-ab3d-4b85-ae71-4827347d79ec tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1315 microversion: 2.1 time: 0.224181 Jul 12 17:27:40.357618 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 111/243] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:40 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:40.402203 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-53014e16-b6da-45f7-a820-ae496313a420 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:40.403186 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-53014e16-b6da-45f7-a820-ae496313a420 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:40.409523 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53014e16-b6da-45f7-a820-ae496313a420 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:40.410143 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53014e16-b6da-45f7-a820-ae496313a420 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:40.411181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53014e16-b6da-45f7-a820-ae496313a420 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:40.411708 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53014e16-b6da-45f7-a820-ae496313a420 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:40.559190 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-53014e16-b6da-45f7-a820-ae496313a420 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:40.570104 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-53014e16-b6da-45f7-a820-ae496313a420 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.171817 Jul 12 17:27:40.571377 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 133/244] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:40 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:41.375970 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-09e13239-54e9-4f73-995a-0b8858df7c44 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:41.377385 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-09e13239-54e9-4f73-995a-0b8858df7c44 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:41.403163 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-09e13239-54e9-4f73-995a-0b8858df7c44 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:41.403854 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-09e13239-54e9-4f73-995a-0b8858df7c44 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:41.404653 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-09e13239-54e9-4f73-995a-0b8858df7c44 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:41.405105 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-09e13239-54e9-4f73-995a-0b8858df7c44 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:41.587891 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6e66ba31-09a5-48c8-a359-d93d9a9ac2ef tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:41.588736 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6e66ba31-09a5-48c8-a359-d93d9a9ac2ef tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:41.601281 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e66ba31-09a5-48c8-a359-d93d9a9ac2ef tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:41.601639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e66ba31-09a5-48c8-a359-d93d9a9ac2ef tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:41.602677 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e66ba31-09a5-48c8-a359-d93d9a9ac2ef tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:41.603272 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e66ba31-09a5-48c8-a359-d93d9a9ac2ef tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:41.677176 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-09e13239-54e9-4f73-995a-0b8858df7c44 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:41.686154 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-09e13239-54e9-4f73-995a-0b8858df7c44 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1315 microversion: 2.1 time: 0.316756 Jul 12 17:27:41.689546 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 112/245] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:41 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:41.936758 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6e66ba31-09a5-48c8-a359-d93d9a9ac2ef tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:41.944747 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6e66ba31-09a5-48c8-a359-d93d9a9ac2ef tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.361409 Jul 12 17:27:41.947563 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 134/246] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:41 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:42.704242 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8f817ce3-c532-4dc2-9e70-9702c2df47f8 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:42.705012 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8f817ce3-c532-4dc2-9e70-9702c2df47f8 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:42.719595 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8f817ce3-c532-4dc2-9e70-9702c2df47f8 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:42.720521 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8f817ce3-c532-4dc2-9e70-9702c2df47f8 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:42.721551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8f817ce3-c532-4dc2-9e70-9702c2df47f8 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:42.722179 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8f817ce3-c532-4dc2-9e70-9702c2df47f8 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:42.939873 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-1f8f4010-0ccd-46d9-a422-09dbe34ce93b req-fff0429a-8d5e-4270-87ae-6d1b77d0477c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "491bc7de-097a-41df-a049-3dffa6008626", "name": "network-vif-plugged", "status": "completed", "tag": "0ddce34f-f407-4b2c-b2d1-7b334aded8ba"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:27:42.956847 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-1f8f4010-0ccd-46d9-a422-09dbe34ce93b req-fff0429a-8d5e-4270-87ae-6d1b77d0477c service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:42.963276 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-1f8f4010-0ccd-46d9-a422-09dbe34ce93b req-fff0429a-8d5e-4270-87ae-6d1b77d0477c service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:42.964325 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8f817ce3-c532-4dc2-9e70-9702c2df47f8 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:42.972810 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8f817ce3-c532-4dc2-9e70-9702c2df47f8 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1315 microversion: 2.1 time: 0.272934 Jul 12 17:27:42.982446 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 113/247] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:42 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:42.990442 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-1f8f4010-0ccd-46d9-a422-09dbe34ce93b req-fff0429a-8d5e-4270-87ae-6d1b77d0477c service nova] Creating event network-vif-plugged:0ddce34f-f407-4b2c-b2d1-7b334aded8ba for instance 491bc7de-097a-41df-a049-3dffa6008626 on hv-cinder-84932 Jul 12 17:27:42.991787 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-160fc020-b81e-496f-b82a-1f1cf3ec4168 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:42.992416 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-160fc020-b81e-496f-b82a-1f1cf3ec4168 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:42.999061 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-1f8f4010-0ccd-46d9-a422-09dbe34ce93b req-fff0429a-8d5e-4270-87ae-6d1b77d0477c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064248 Jul 12 17:27:43.000108 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 135/248] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:27:43.003555 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-160fc020-b81e-496f-b82a-1f1cf3ec4168 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:43.004025 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-160fc020-b81e-496f-b82a-1f1cf3ec4168 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:43.004800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-160fc020-b81e-496f-b82a-1f1cf3ec4168 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:43.005239 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-160fc020-b81e-496f-b82a-1f1cf3ec4168 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:43.188659 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-160fc020-b81e-496f-b82a-1f1cf3ec4168 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:43.198410 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-160fc020-b81e-496f-b82a-1f1cf3ec4168 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.217529 Jul 12 17:27:43.199267 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 114/249] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:42 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:43.991087 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-63b4094b-2ad4-4ad4-87e6-4f73a92ce26f tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:43.992501 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-63b4094b-2ad4-4ad4-87e6-4f73a92ce26f tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:44.003679 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-63b4094b-2ad4-4ad4-87e6-4f73a92ce26f tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:44.006080 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-63b4094b-2ad4-4ad4-87e6-4f73a92ce26f tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:44.007210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-63b4094b-2ad4-4ad4-87e6-4f73a92ce26f tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:44.009459 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-63b4094b-2ad4-4ad4-87e6-4f73a92ce26f tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:44.216597 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-31d58d72-1291-45f1-8053-e19091c191ad tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:44.218038 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-31d58d72-1291-45f1-8053-e19091c191ad tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:44.236751 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-31d58d72-1291-45f1-8053-e19091c191ad tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:44.237512 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-31d58d72-1291-45f1-8053-e19091c191ad tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:44.238541 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-31d58d72-1291-45f1-8053-e19091c191ad tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:44.239182 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-31d58d72-1291-45f1-8053-e19091c191ad tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:44.810687 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-63b4094b-2ad4-4ad4-87e6-4f73a92ce26f tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:44.821503 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-63b4094b-2ad4-4ad4-87e6-4f73a92ce26f tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1315 microversion: 2.1 time: 0.834549 Jul 12 17:27:44.822113 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 136/250] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:43 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1315 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:44.868305 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-31d58d72-1291-45f1-8053-e19091c191ad tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:44.913196 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-31d58d72-1291-45f1-8053-e19091c191ad tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.701668 Jul 12 17:27:44.927409 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 115/251] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:44 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:27:45.841529 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2d3c0b9f-aafd-41f9-b440-e8d78fff89e2 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:45.842177 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2d3c0b9f-aafd-41f9-b440-e8d78fff89e2 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:45.858014 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d3c0b9f-aafd-41f9-b440-e8d78fff89e2 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:45.861432 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d3c0b9f-aafd-41f9-b440-e8d78fff89e2 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:45.862493 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d3c0b9f-aafd-41f9-b440-e8d78fff89e2 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:45.862935 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d3c0b9f-aafd-41f9-b440-e8d78fff89e2 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:45.934208 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7f997e58-ea19-4eb3-a6ed-52e43788e3e4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:45.936060 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7f997e58-ea19-4eb3-a6ed-52e43788e3e4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:45.954129 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f997e58-ea19-4eb3-a6ed-52e43788e3e4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:45.954980 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f997e58-ea19-4eb3-a6ed-52e43788e3e4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:45.956299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f997e58-ea19-4eb3-a6ed-52e43788e3e4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:45.957033 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f997e58-ea19-4eb3-a6ed-52e43788e3e4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:46.212612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2d3c0b9f-aafd-41f9-b440-e8d78fff89e2 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:46.223544 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2d3c0b9f-aafd-41f9-b440-e8d78fff89e2 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1315 microversion: 2.1 time: 0.388687 Jul 12 17:27:46.227070 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 137/252] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:45 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:46.386045 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7f997e58-ea19-4eb3-a6ed-52e43788e3e4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:46.397816 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7f997e58-ea19-4eb3-a6ed-52e43788e3e4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1522 microversion: 2.1 time: 0.469164 Jul 12 17:27:46.399398 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 116/253] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:45 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:47.246576 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b5df9721-7e47-4404-bfb4-3da4b28ca673 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:47.248437 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b5df9721-7e47-4404-bfb4-3da4b28ca673 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:47.258104 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b5df9721-7e47-4404-bfb4-3da4b28ca673 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:47.258830 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b5df9721-7e47-4404-bfb4-3da4b28ca673 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:47.259619 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b5df9721-7e47-4404-bfb4-3da4b28ca673 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:47.260358 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b5df9721-7e47-4404-bfb4-3da4b28ca673 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:47.419219 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a6b6f698-4c3f-428b-96cf-1e571fbe7875 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:47.421553 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a6b6f698-4c3f-428b-96cf-1e571fbe7875 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:47.430472 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a6b6f698-4c3f-428b-96cf-1e571fbe7875 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:47.432391 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a6b6f698-4c3f-428b-96cf-1e571fbe7875 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:47.434643 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a6b6f698-4c3f-428b-96cf-1e571fbe7875 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:47.436078 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a6b6f698-4c3f-428b-96cf-1e571fbe7875 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:47.486726 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b5df9721-7e47-4404-bfb4-3da4b28ca673 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:47.503121 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b5df9721-7e47-4404-bfb4-3da4b28ca673 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1315 microversion: 2.1 time: 0.264054 Jul 12 17:27:47.526238 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 138/254] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:47 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:47.798212 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a6b6f698-4c3f-428b-96cf-1e571fbe7875 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:47.814757 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a6b6f698-4c3f-428b-96cf-1e571fbe7875 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1502 microversion: 2.1 time: 0.396473 Jul 12 17:27:47.815845 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 117/255] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:47 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1502 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:47.836878 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f7f0fdef-21c4-4dfa-ba00-e416561e9e28 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:47.838065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f7f0fdef-21c4-4dfa-ba00-e416561e9e28 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:47.846080 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f7f0fdef-21c4-4dfa-ba00-e416561e9e28 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:47.846807 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f7f0fdef-21c4-4dfa-ba00-e416561e9e28 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:47.848003 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f7f0fdef-21c4-4dfa-ba00-e416561e9e28 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:47.848932 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f7f0fdef-21c4-4dfa-ba00-e416561e9e28 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:48.117802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f7f0fdef-21c4-4dfa-ba00-e416561e9e28 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:48.128344 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f7f0fdef-21c4-4dfa-ba00-e416561e9e28 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1515 microversion: 2.1 time: 0.299539 Jul 12 17:27:48.135462 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 139/256] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:47 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1515 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:48.536249 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-45a3b63a-44b7-4d5a-835c-f4b8d7000b78 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:48.536877 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-45a3b63a-44b7-4d5a-835c-f4b8d7000b78 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:48.551693 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-45a3b63a-44b7-4d5a-835c-f4b8d7000b78 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:48.553334 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-45a3b63a-44b7-4d5a-835c-f4b8d7000b78 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:48.556825 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-45a3b63a-44b7-4d5a-835c-f4b8d7000b78 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:48.557886 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-45a3b63a-44b7-4d5a-835c-f4b8d7000b78 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:49.022588 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-45a3b63a-44b7-4d5a-835c-f4b8d7000b78 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:49.034611 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-45a3b63a-44b7-4d5a-835c-f4b8d7000b78 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1464 microversion: 2.1 time: 0.504657 Jul 12 17:27:49.049927 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 118/257] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:48 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1464 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:49.112130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-82eb7850-af69-437c-b194-8edf3b9f02fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:49.112769 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-82eb7850-af69-437c-b194-8edf3b9f02fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:49.120280 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-82eb7850-af69-437c-b194-8edf3b9f02fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:49.120963 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-82eb7850-af69-437c-b194-8edf3b9f02fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:49.121999 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-82eb7850-af69-437c-b194-8edf3b9f02fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:49.123190 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-82eb7850-af69-437c-b194-8edf3b9f02fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:49.179392 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-82eb7850-af69-437c-b194-8edf3b9f02fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:27:49.184571 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:49.413981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-82eb7850-af69-437c-b194-8edf3b9f02fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "DELETE /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 204 len: 0 microversion: 2.1 time: 0.312252 Jul 12 17:27:49.414869 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 140/258] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:27:49 2022] DELETE /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:27:49.424695 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-75f03703-0510-490c-8eee-d5d7d21d94c8 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:49.425307 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-75f03703-0510-490c-8eee-d5d7d21d94c8 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:49.437190 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-75f03703-0510-490c-8eee-d5d7d21d94c8 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:49.443462 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-75f03703-0510-490c-8eee-d5d7d21d94c8 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:49.444512 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-75f03703-0510-490c-8eee-d5d7d21d94c8 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:49.449343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-75f03703-0510-490c-8eee-d5d7d21d94c8 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:49.726385 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-75f03703-0510-490c-8eee-d5d7d21d94c8 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:49.745854 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-75f03703-0510-490c-8eee-d5d7d21d94c8 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1470 microversion: 2.1 time: 0.325044 Jul 12 17:27:49.747456 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 119/259] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:49 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1470 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:50.080772 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-652d7c52-67a5-4a92-b211-e3061ef3e001 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:27:50.082002 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-652d7c52-67a5-4a92-b211-e3061ef3e001 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:50.101592 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-652d7c52-67a5-4a92-b211-e3061ef3e001 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:50.104190 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-652d7c52-67a5-4a92-b211-e3061ef3e001 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:50.105315 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-652d7c52-67a5-4a92-b211-e3061ef3e001 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:50.106866 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-652d7c52-67a5-4a92-b211-e3061ef3e001 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:50.187694 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-652d7c52-67a5-4a92-b211-e3061ef3e001 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lazy-loading 'flavor' on Instance uuid f4d99e1a-efd3-4510-ac75-1c21c7937044 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:27:50.353438 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-652d7c52-67a5-4a92-b211-e3061ef3e001 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "POST /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044/action" status: 200 len: 32 microversion: 2.1 time: 0.277529 Jul 12 17:27:50.354267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 141/260] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Jul 12 17:27:50 2022] POST /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044/action => generated 32 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 17:27:50.364953 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5be9c485-0c70-4f15-9a8d-dc1b5e518019 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:50.365963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5be9c485-0c70-4f15-9a8d-dc1b5e518019 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:50.376424 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5be9c485-0c70-4f15-9a8d-dc1b5e518019 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:50.377838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5be9c485-0c70-4f15-9a8d-dc1b5e518019 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:50.380104 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5be9c485-0c70-4f15-9a8d-dc1b5e518019 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:50.381715 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5be9c485-0c70-4f15-9a8d-dc1b5e518019 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:50.764232 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e0a2549f-273c-4522-977c-16eb1108cfea tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:50.765244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e0a2549f-273c-4522-977c-16eb1108cfea tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:50.785091 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0a2549f-273c-4522-977c-16eb1108cfea tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:50.800358 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0a2549f-273c-4522-977c-16eb1108cfea tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:50.801781 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0a2549f-273c-4522-977c-16eb1108cfea tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:50.802298 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0a2549f-273c-4522-977c-16eb1108cfea tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:50.860749 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5be9c485-0c70-4f15-9a8d-dc1b5e518019 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:50.869016 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5be9c485-0c70-4f15-9a8d-dc1b5e518019 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.509377 Jul 12 17:27:50.873453 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 120/261] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:50 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:27:51.309273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e0a2549f-273c-4522-977c-16eb1108cfea tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:51.319745 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e0a2549f-273c-4522-977c-16eb1108cfea tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1470 microversion: 2.1 time: 0.559922 Jul 12 17:27:51.333493 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 142/262] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:50 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1470 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:27:51.895049 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a1b2e274-44b2-41b6-b5f0-e966c99ceabe tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:51.895920 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a1b2e274-44b2-41b6-b5f0-e966c99ceabe tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:51.908645 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a1b2e274-44b2-41b6-b5f0-e966c99ceabe tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:51.909108 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a1b2e274-44b2-41b6-b5f0-e966c99ceabe tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:51.913154 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a1b2e274-44b2-41b6-b5f0-e966c99ceabe tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:51.913990 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a1b2e274-44b2-41b6-b5f0-e966c99ceabe tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:52.253307 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a1b2e274-44b2-41b6-b5f0-e966c99ceabe tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:52.263250 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a1b2e274-44b2-41b6-b5f0-e966c99ceabe tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.371898 Jul 12 17:27:52.279764 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 121/263] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:51 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:52.340282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-731c6436-0339-4443-ac72-1b47e9184228 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:52.340935 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-731c6436-0339-4443-ac72-1b47e9184228 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:52.348949 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-731c6436-0339-4443-ac72-1b47e9184228 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:52.352139 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-731c6436-0339-4443-ac72-1b47e9184228 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:52.353122 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-731c6436-0339-4443-ac72-1b47e9184228 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:52.355698 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-731c6436-0339-4443-ac72-1b47e9184228 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:52.451719 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-d4430d26-ca40-44d0-b059-c02a12b8e266 req-442e822e-70ab-4df5-8f41-faf6ccb4b44a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "491bc7de-097a-41df-a049-3dffa6008626", "name": "network-vif-deleted", "tag": "0ddce34f-f407-4b2c-b2d1-7b334aded8ba"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:27:52.472360 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-d4430d26-ca40-44d0-b059-c02a12b8e266 req-442e822e-70ab-4df5-8f41-faf6ccb4b44a service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:52.473010 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-d4430d26-ca40-44d0-b059-c02a12b8e266 req-442e822e-70ab-4df5-8f41-faf6ccb4b44a service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:52.518896 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-d4430d26-ca40-44d0-b059-c02a12b8e266 req-442e822e-70ab-4df5-8f41-faf6ccb4b44a service nova] Creating event network-vif-deleted:0ddce34f-f407-4b2c-b2d1-7b334aded8ba for instance 491bc7de-097a-41df-a049-3dffa6008626 on hv-cinder-84932 Jul 12 17:27:52.528984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-d4430d26-ca40-44d0-b059-c02a12b8e266 req-442e822e-70ab-4df5-8f41-faf6ccb4b44a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080292 Jul 12 17:27:52.535205 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 122/264] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:27:52.548011 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-731c6436-0339-4443-ac72-1b47e9184228 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:52.556099 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-731c6436-0339-4443-ac72-1b47e9184228 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1428 microversion: 2.1 time: 0.219612 Jul 12 17:27:52.557007 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 143/265] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:52 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1428 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:53.211107 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-dfdb70db-e8ec-4f6f-8793-d36f1cc18ec3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Action: 'create', calling method: .version_select at 0x7f872a30a9d0>, body: {"keypair": {"name": "tempest-keypair-1005991805", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaWMsR91QBpvEoHNsIA0vepdzWOK8qCbMGqFth9nn3dlM0Zh2+5sXLyHMlM5+59cfWxxKCPakXmtXUKqrNBoZSg+2oF85ZPpSG3xn2smIsDiibCuCiuhcGylrtpSs8keQ=="}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:27:53.246819 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-dfdb70db-e8ec-4f6f-8793-d36f1cc18ec3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Getting quotas for project a47989251b16474f830f5a46efe33812. Resources: {'key_pairs'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:27:53.251936 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-dfdb70db-e8ec-4f6f-8793-d36f1cc18ec3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Getting quotas for user 673bd0c57ab842f4925c770c8959354d and project a47989251b16474f830f5a46efe33812. Resources: {'key_pairs'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:27:53.281351 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2ddd598f-5f4d-40e1-a819-7bec35bb62c7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:53.282607 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2ddd598f-5f4d-40e1-a819-7bec35bb62c7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:53.303957 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2ddd598f-5f4d-40e1-a819-7bec35bb62c7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:53.310785 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2ddd598f-5f4d-40e1-a819-7bec35bb62c7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:53.313118 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2ddd598f-5f4d-40e1-a819-7bec35bb62c7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:53.317328 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2ddd598f-5f4d-40e1-a819-7bec35bb62c7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:53.363771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-dfdb70db-e8ec-4f6f-8793-d36f1cc18ec3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.477829 Jul 12 17:27:53.369384 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 123/266] 10.222.0.62 () {62 vars in 1199 bytes} [Tue Jul 12 17:27:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 483 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 17:27:53.574169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0d37973a-af7f-43b0-b218-8f3843de320c tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:53.574916 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0d37973a-af7f-43b0-b218-8f3843de320c tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:53.583716 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2ddd598f-5f4d-40e1-a819-7bec35bb62c7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:53.593240 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2ddd598f-5f4d-40e1-a819-7bec35bb62c7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.316632 Jul 12 17:27:53.597786 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 144/267] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:53 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:27:53.597958 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0d37973a-af7f-43b0-b218-8f3843de320c tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:53.598193 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0d37973a-af7f-43b0-b218-8f3843de320c tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:53.598975 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0d37973a-af7f-43b0-b218-8f3843de320c tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:53.599413 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0d37973a-af7f-43b0-b218-8f3843de320c tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:53.793209 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0d37973a-af7f-43b0-b218-8f3843de320c tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:53.805331 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0d37973a-af7f-43b0-b218-8f3843de320c tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1428 microversion: 2.1 time: 0.235549 Jul 12 17:27:53.806267 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 124/268] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:53 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1428 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:54.610940 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5634ab8f-6ee1-478f-8178-f80ebde4a82d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:54.613401 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5634ab8f-6ee1-478f-8178-f80ebde4a82d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:54.627283 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5634ab8f-6ee1-478f-8178-f80ebde4a82d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:54.628048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5634ab8f-6ee1-478f-8178-f80ebde4a82d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:54.631378 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5634ab8f-6ee1-478f-8178-f80ebde4a82d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:54.632131 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5634ab8f-6ee1-478f-8178-f80ebde4a82d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:54.823446 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cf5c7b8d-c1a3-460b-971e-9172380cba87 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:54.825032 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-cf5c7b8d-c1a3-460b-971e-9172380cba87 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:54.832286 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cf5c7b8d-c1a3-460b-971e-9172380cba87 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:54.833035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cf5c7b8d-c1a3-460b-971e-9172380cba87 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:54.834025 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cf5c7b8d-c1a3-460b-971e-9172380cba87 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:54.834614 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cf5c7b8d-c1a3-460b-971e-9172380cba87 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:54.929943 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5634ab8f-6ee1-478f-8178-f80ebde4a82d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:54.940956 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cf5c7b8d-c1a3-460b-971e-9172380cba87 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a075319aaa5d4725887d2ba384277b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c31a89a56f14fcd94b54e0d66b9c56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:54.954240 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5634ab8f-6ee1-478f-8178-f80ebde4a82d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.347700 Jul 12 17:27:54.955073 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 145/269] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:54 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:54.957052 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-cf5c7b8d-c1a3-460b-971e-9172380cba87 tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 200 len: 1428 microversion: 2.1 time: 0.136821 Jul 12 17:27:54.966503 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 125/270] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:54 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 1428 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:55.631189 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-988d83e2-0091-4091-b383-3be93d4346f2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-952228810", "imageRef": "b19e7830-75c9-4706-bd34-4954ba6b4cc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f555be57-c537-4463-873d-2fa611295c76"}], "security_groups": [{"name": "tempest-securitygroup--1925039684"}], "key_name": "tempest-keypair-1005991805", "user_data": "}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:27:55.754470 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-988d83e2-0091-4091-b383-3be93d4346f2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] validate_networks() for [('f555be57-c537-4463-873d-2fa611295c76', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:27:55.973666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ed70af9a-bb8f-4faa-b917-e0ff08b80118 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:55.974991 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ed70af9a-bb8f-4faa-b917-e0ff08b80118 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:55.992186 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ed70af9a-bb8f-4faa-b917-e0ff08b80118 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:55.992640 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ed70af9a-bb8f-4faa-b917-e0ff08b80118 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:55.993425 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ed70af9a-bb8f-4faa-b917-e0ff08b80118 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:55.997984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ed70af9a-bb8f-4faa-b917-e0ff08b80118 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:56.471280 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ed70af9a-bb8f-4faa-b917-e0ff08b80118 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:56.480951 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:56.486779 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ed70af9a-bb8f-4faa-b917-e0ff08b80118 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.519041 Jul 12 17:27:56.487742 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 126/271] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:55 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:27:56.498708 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-af19a111-22a6-43fb-a891-43ee78b7d4fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:56.499631 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-af19a111-22a6-43fb-a891-43ee78b7d4fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] [instance: 491bc7de-097a-41df-a049-3dffa6008626] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:56.510129 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-af19a111-22a6-43fb-a891-43ee78b7d4fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:56.510882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-af19a111-22a6-43fb-a891-43ee78b7d4fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:56.513268 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-af19a111-22a6-43fb-a891-43ee78b7d4fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:56.513900 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-af19a111-22a6-43fb-a891-43ee78b7d4fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:56.535309 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-af19a111-22a6-43fb-a891-43ee78b7d4fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] HTTP exception thrown: Instance 491bc7de-097a-41df-a049-3dffa6008626 could not be found. Jul 12 17:27:56.538427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-af19a111-22a6-43fb-a891-43ee78b7d4fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Request method failure captured: Jul 12 17:27:56.538427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 HTTP/1.1 Jul 12 17:27:56.538427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:27:56.538427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:27:56.538427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:27:56.538427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:27:56.538427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:27:56.538427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:27:56.538427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:27:56.538427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:27:56.538427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza73hLvx02dMHsoWXspoXcRA62gV2uUJXj4p_6js0UQvMqMxMmwNgLjGKHtA-HZ67HkyQwBh23UqdK5Q5xS6zgJImcc5P2NXXHv-LX-BWSVzkN5qiHkkFjG_xbucuIntD2v_naMBCvuSbschV34czInez2lcYhDQ261gLK05I-j9qek Jul 12 17:27:56.538427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:27:56.538427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:27:56.538427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:27:56.538427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:27:56.538427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:27:56.538427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:27:56.538427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: 4c31a89a56f14fcd94b54e0d66b9c56e Jul 12 17:27:56.538427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-VolumesNegativeTest-1187570549 Jul 12 17:27:56.538427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:27:56.538427 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:27:56.540319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4c31a89a56f14fcd94b54e0d66b9c56e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4c31a89a56f14fcd94b54e0d66b9c56e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4c31a89a56f14fcd94b54e0d66b9c56e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4c31a89a56f14fcd94b54e0d66b9c56e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:27:56.540319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-VolumesNegativeTest-1187570549 Jul 12 17:27:56.540319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 4c31a89a56f14fcd94b54e0d66b9c56e Jul 12 17:27:56.540319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-VolumesNegativeTest-1187570549 Jul 12 17:27:56.540319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-VolumesNegativeTest-1187570549-project Jul 12 17:27:56.540319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:27:56.540319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:27:56.540319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: a075319aaa5d4725887d2ba384277b36 Jul 12 17:27:56.540319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-VolumesNegativeTest-1187570549-project Jul 12 17:27:56.540319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:27:56.540319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance 491bc7de-097a-41df-a049-3dffa6008626 could not be found. Jul 12 17:27:56.540319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': '491bc7de-097a-41df-a049-3dffa6008626'} Jul 12 17:27:56.541389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:27:56.541389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:27:56.541389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:27:56.541389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:27:56.541389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:27:56.541389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:27:56.541389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:27:56.541389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:27:56.541389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:27:56.541389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:27:56.541389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 491bc7de-097a-41df-a049-3dffa6008626 could not be found. Jul 12 17:27:56.541389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:56.541389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:27:56.541389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:56.541389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:27:56.541389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:27:56.541389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:27:56.541389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:27:56.541389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:27:56.541389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:27:56.542969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:27:56.542969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:27:56.542969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:27:56.542969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:27:56.542969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:27:56.542969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:27:56.542969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:27:56.542969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 491bc7de-097a-41df-a049-3dffa6008626 could not be found. Jul 12 17:27:56.542969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:56.542969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:27:56.542969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:56.542969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:27:56.542969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:27:56.542969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:27:56.542969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:27:56.542969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:27:56.542969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 491bc7de-097a-41df-a049-3dffa6008626 could not be found. Jul 12 17:27:56.542969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:27:56.547106 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-af19a111-22a6-43fb-a891-43ee78b7d4fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] Returning 404 to user: Instance 491bc7de-097a-41df-a049-3dffa6008626 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:27:56.548645 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-af19a111-22a6-43fb-a891-43ee78b7d4fa tempest-VolumesNegativeTest-1187570549 tempest-VolumesNegativeTest-1187570549-project] 10.222.0.62 "GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626" status: 404 len: 111 microversion: 2.1 time: 0.059747 Jul 12 17:27:56.550132 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 127/272] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:56 2022] GET /compute/v2.1/servers/491bc7de-097a-41df-a049-3dffa6008626 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:27:56.583729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-988d83e2-0091-4091-b383-3be93d4346f2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:27:56.584165 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-988d83e2-0091-4091-b383-3be93d4346f2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:27:56.584644 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-988d83e2-0091-4091-b383-3be93d4346f2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:27:56.585053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-988d83e2-0091-4091-b383-3be93d4346f2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:27:56.585510 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-988d83e2-0091-4091-b383-3be93d4346f2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:27:56.601354 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-988d83e2-0091-4091-b383-3be93d4346f2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:56.601938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-988d83e2-0091-4091-b383-3be93d4346f2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:56.602765 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-988d83e2-0091-4091-b383-3be93d4346f2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:56.611240 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-988d83e2-0091-4091-b383-3be93d4346f2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:56.655955 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-988d83e2-0091-4091-b383-3be93d4346f2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Getting quotas for project a47989251b16474f830f5a46efe33812. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:27:56.666949 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-988d83e2-0091-4091-b383-3be93d4346f2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Getting quotas for user 673bd0c57ab842f4925c770c8959354d and project a47989251b16474f830f5a46efe33812. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:27:56.698467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-988d83e2-0091-4091-b383-3be93d4346f2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:27:56.705886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-988d83e2-0091-4091-b383-3be93d4346f2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19e7830-75c9-4706-bd34-4954ba6b4cc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:27:56.777652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-988d83e2-0091-4091-b383-3be93d4346f2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.151662 Jul 12 17:27:56.779741 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 146/273] 10.222.0.62 () {62 vars in 1187 bytes} [Tue Jul 12 17:27:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 12 17:27:56.790745 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-55f7235b-6162-48f6-bf53-71aca67c78d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:56.791634 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-55f7235b-6162-48f6-bf53-71aca67c78d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:56.906257 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-55f7235b-6162-48f6-bf53-71aca67c78d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:56.919078 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-55f7235b-6162-48f6-bf53-71aca67c78d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:56.923210 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-55f7235b-6162-48f6-bf53-71aca67c78d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:56.926582 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-55f7235b-6162-48f6-bf53-71aca67c78d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1281 microversion: 2.20 time: 0.139698 Jul 12 17:27:56.929520 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 128/274] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:27:56 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1281 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:27:57.504916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-efd379ca-4a4b-4747-9186-2f85ae9cdb3b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:57.505888 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-efd379ca-4a4b-4747-9186-2f85ae9cdb3b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:57.521350 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-efd379ca-4a4b-4747-9186-2f85ae9cdb3b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:57.522946 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-efd379ca-4a4b-4747-9186-2f85ae9cdb3b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:57.525374 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-efd379ca-4a4b-4747-9186-2f85ae9cdb3b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:57.526584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-efd379ca-4a4b-4747-9186-2f85ae9cdb3b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:57.900356 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-efd379ca-4a4b-4747-9186-2f85ae9cdb3b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:57.911513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-efd379ca-4a4b-4747-9186-2f85ae9cdb3b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.410978 Jul 12 17:27:57.916183 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 147/275] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:57 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:57.947392 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6b554b3d-e776-468a-9436-f002e2c54cfa tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:57.949261 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6b554b3d-e776-468a-9436-f002e2c54cfa tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:57.968776 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6b554b3d-e776-468a-9436-f002e2c54cfa tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:57.971597 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6b554b3d-e776-468a-9436-f002e2c54cfa tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:57.972533 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6b554b3d-e776-468a-9436-f002e2c54cfa tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:57.974237 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6b554b3d-e776-468a-9436-f002e2c54cfa tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:58.129463 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6b554b3d-e776-468a-9436-f002e2c54cfa tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:58.141567 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6b554b3d-e776-468a-9436-f002e2c54cfa tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:58.143434 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6b554b3d-e776-468a-9436-f002e2c54cfa tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:58.144753 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6b554b3d-e776-468a-9436-f002e2c54cfa tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1285 microversion: 2.20 time: 0.202766 Jul 12 17:27:58.145334 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 129/276] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:27:57 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1285 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:27:58.936270 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-42edfa0d-521b-4d6f-953c-2946b2da60b6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:58.937036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-42edfa0d-521b-4d6f-953c-2946b2da60b6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:58.950324 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-42edfa0d-521b-4d6f-953c-2946b2da60b6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:58.951223 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-42edfa0d-521b-4d6f-953c-2946b2da60b6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:58.954351 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-42edfa0d-521b-4d6f-953c-2946b2da60b6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:58.955577 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-42edfa0d-521b-4d6f-953c-2946b2da60b6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:59.163941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ea0a7116-36ea-4303-9df2-d4ec79a9b252 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:27:59.164538 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ea0a7116-36ea-4303-9df2-d4ec79a9b252 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:27:59.182027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ea0a7116-36ea-4303-9df2-d4ec79a9b252 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:59.183731 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ea0a7116-36ea-4303-9df2-d4ec79a9b252 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:59.185184 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ea0a7116-36ea-4303-9df2-d4ec79a9b252 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:27:59.185624 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ea0a7116-36ea-4303-9df2-d4ec79a9b252 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:27:59.284437 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-42edfa0d-521b-4d6f-953c-2946b2da60b6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:59.296340 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-42edfa0d-521b-4d6f-953c-2946b2da60b6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.367522 Jul 12 17:27:59.296928 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 148/277] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:27:58 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:27:59.371558 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ea0a7116-36ea-4303-9df2-d4ec79a9b252 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:59.386708 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ea0a7116-36ea-4303-9df2-d4ec79a9b252 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:59.388285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ea0a7116-36ea-4303-9df2-d4ec79a9b252 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:27:59.389391 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ea0a7116-36ea-4303-9df2-d4ec79a9b252 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1341 microversion: 2.20 time: 0.229427 Jul 12 17:27:59.389980 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 130/278] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:27:59 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1341 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:28:00.313148 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9578ef7f-53b3-4768-be07-025595fbe3be tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:00.313810 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9578ef7f-53b3-4768-be07-025595fbe3be tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:00.325255 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9578ef7f-53b3-4768-be07-025595fbe3be tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:00.326050 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9578ef7f-53b3-4768-be07-025595fbe3be tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:00.327047 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9578ef7f-53b3-4768-be07-025595fbe3be tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:00.327672 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9578ef7f-53b3-4768-be07-025595fbe3be tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:00.407556 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-914ce7cb-a1bd-4163-a41d-de01d4574201 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:00.408674 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-914ce7cb-a1bd-4163-a41d-de01d4574201 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:00.420014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-914ce7cb-a1bd-4163-a41d-de01d4574201 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:00.420719 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-914ce7cb-a1bd-4163-a41d-de01d4574201 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:00.421653 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-914ce7cb-a1bd-4163-a41d-de01d4574201 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:00.430360 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-914ce7cb-a1bd-4163-a41d-de01d4574201 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:00.550336 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-914ce7cb-a1bd-4163-a41d-de01d4574201 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:00.568429 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-914ce7cb-a1bd-4163-a41d-de01d4574201 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:00.570004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-914ce7cb-a1bd-4163-a41d-de01d4574201 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:00.571404 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-914ce7cb-a1bd-4163-a41d-de01d4574201 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1339 microversion: 2.20 time: 0.167495 Jul 12 17:28:00.571950 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 131/279] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:00 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1339 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:00.623012 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9578ef7f-53b3-4768-be07-025595fbe3be tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:00.632099 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9578ef7f-53b3-4768-be07-025595fbe3be tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.323446 Jul 12 17:28:00.634691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 149/280] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:00 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:01.591666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1af70ec7-5b9e-4675-b37f-ece61bd61d1f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:01.592685 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1af70ec7-5b9e-4675-b37f-ece61bd61d1f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:01.606615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1af70ec7-5b9e-4675-b37f-ece61bd61d1f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:01.608048 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1af70ec7-5b9e-4675-b37f-ece61bd61d1f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:01.609099 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1af70ec7-5b9e-4675-b37f-ece61bd61d1f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:01.611116 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1af70ec7-5b9e-4675-b37f-ece61bd61d1f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:01.655305 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2aed403d-f009-4e78-b581-56bd2baa9bf9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:01.657376 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2aed403d-f009-4e78-b581-56bd2baa9bf9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:01.665417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2aed403d-f009-4e78-b581-56bd2baa9bf9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:01.666740 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2aed403d-f009-4e78-b581-56bd2baa9bf9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:01.668370 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2aed403d-f009-4e78-b581-56bd2baa9bf9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:01.669212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2aed403d-f009-4e78-b581-56bd2baa9bf9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:02.022069 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1af70ec7-5b9e-4675-b37f-ece61bd61d1f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:02.031071 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2aed403d-f009-4e78-b581-56bd2baa9bf9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:02.045861 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2aed403d-f009-4e78-b581-56bd2baa9bf9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.393560 Jul 12 17:28:02.046503 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 150/281] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:01 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:02.046677 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1af70ec7-5b9e-4675-b37f-ece61bd61d1f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:02.049955 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1af70ec7-5b9e-4675-b37f-ece61bd61d1f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:02.051986 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1af70ec7-5b9e-4675-b37f-ece61bd61d1f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.464123 Jul 12 17:28:02.073240 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 132/282] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:01 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:02.098764 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-989f6b89-fdd1-43a9-ab3d-5ce48db0bef9 req-7075ed89-4c9e-4e8e-b944-2553eeb715b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48b5e50f-5079-438b-ac33-67623b4428f5", "tag": "e0dd8828-dbc7-4d01-9d3f-ee997fb3d5ce"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:28:02.110683 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-989f6b89-fdd1-43a9-ab3d-5ce48db0bef9 req-7075ed89-4c9e-4e8e-b944-2553eeb715b9 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:02.111456 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-989f6b89-fdd1-43a9-ab3d-5ce48db0bef9 req-7075ed89-4c9e-4e8e-b944-2553eeb715b9 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:02.148776 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-989f6b89-fdd1-43a9-ab3d-5ce48db0bef9 req-7075ed89-4c9e-4e8e-b944-2553eeb715b9 service nova] Creating event network-changed:e0dd8828-dbc7-4d01-9d3f-ee997fb3d5ce for instance 48b5e50f-5079-438b-ac33-67623b4428f5 on hv-cinder-84932 Jul 12 17:28:02.154783 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-989f6b89-fdd1-43a9-ab3d-5ce48db0bef9 req-7075ed89-4c9e-4e8e-b944-2553eeb715b9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058899 Jul 12 17:28:02.155916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 151/283] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:28:02.217005 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-82416e1c-51db-48c7-8f77-8ff510c3ed40 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Action: 'create', calling method: .version_select at 0x7f872a5430d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1932402175", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJIXhOa9MkXGABlYWc8F14bk5UI40u5Ly2uVSsE38ueJ2b6bZavNV6AC48e1L72QjVxamvdNx6cadJMb1jmEWcQW6hk95yInX3uU0/RU/XOTuuYhXVsopU9z1nJqr1XZA=="}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:28:02.232715 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-82416e1c-51db-48c7-8f77-8ff510c3ed40 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Getting quotas for project 958ea0774e9d41a5a995b2693d0b0c6e. Resources: {'key_pairs'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:28:02.236681 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-82416e1c-51db-48c7-8f77-8ff510c3ed40 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Getting quotas for user c9159fc216f14b9a9044f6ddb0d9f7b7 and project 958ea0774e9d41a5a995b2693d0b0c6e. Resources: {'key_pairs'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:28:02.259910 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-82416e1c-51db-48c7-8f77-8ff510c3ed40 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050207 Jul 12 17:28:02.271626 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 133/284] 10.222.0.62 () {60 vars in 1158 bytes} [Tue Jul 12 17:28:02 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:28:02.331198 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2df2da3c-8cb8-49af-b7d8-46b7535231a5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-286983757", "imageRef": "3eefa200-e528-4a6c-bbf7-d8b45b1bf2d4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1932402175", "networks": [{"uuid": "4e20f143-0fd0-4b40-be12-3321a43578ac"}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:28:02.392790 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-2df2da3c-8cb8-49af-b7d8-46b7535231a5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] validate_networks() for [('4e20f143-0fd0-4b40-be12-3321a43578ac', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:28:02.736637 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:03.052559 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-2df2da3c-8cb8-49af-b7d8-46b7535231a5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:28:03.053183 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-2df2da3c-8cb8-49af-b7d8-46b7535231a5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:28:03.054262 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-2df2da3c-8cb8-49af-b7d8-46b7535231a5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:28:03.054833 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-2df2da3c-8cb8-49af-b7d8-46b7535231a5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:28:03.055534 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-2df2da3c-8cb8-49af-b7d8-46b7535231a5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:28:03.066401 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6057e821-00fa-486d-88c5-336e56e5a8a4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:03.067088 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6057e821-00fa-486d-88c5-336e56e5a8a4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:03.076808 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2df2da3c-8cb8-49af-b7d8-46b7535231a5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:03.078281 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2df2da3c-8cb8-49af-b7d8-46b7535231a5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:03.078409 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6057e821-00fa-486d-88c5-336e56e5a8a4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:03.078870 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6057e821-00fa-486d-88c5-336e56e5a8a4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:03.079185 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2df2da3c-8cb8-49af-b7d8-46b7535231a5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:03.079521 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6057e821-00fa-486d-88c5-336e56e5a8a4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:03.079666 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2df2da3c-8cb8-49af-b7d8-46b7535231a5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:03.081012 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6057e821-00fa-486d-88c5-336e56e5a8a4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:03.108357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-2df2da3c-8cb8-49af-b7d8-46b7535231a5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Getting quotas for project 958ea0774e9d41a5a995b2693d0b0c6e. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:28:03.116971 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-2df2da3c-8cb8-49af-b7d8-46b7535231a5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Getting quotas for user c9159fc216f14b9a9044f6ddb0d9f7b7 and project 958ea0774e9d41a5a995b2693d0b0c6e. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:28:03.131226 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2df2da3c-8cb8-49af-b7d8-46b7535231a5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:28:03.134104 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2df2da3c-8cb8-49af-b7d8-46b7535231a5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3eefa200-e528-4a6c-bbf7-d8b45b1bf2d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:28:03.239536 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2df2da3c-8cb8-49af-b7d8-46b7535231a5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.912477 Jul 12 17:28:03.240458 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 152/285] 10.222.0.62 () {60 vars in 1146 bytes} [Tue Jul 12 17:28:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:28:03.249619 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d1d1c7eb-3077-4cc7-a1bd-beaac26d74b0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:03.251009 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d1d1c7eb-3077-4cc7-a1bd-beaac26d74b0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:03.290938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d1d1c7eb-3077-4cc7-a1bd-beaac26d74b0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:03.294860 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d1d1c7eb-3077-4cc7-a1bd-beaac26d74b0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:03.295958 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d1d1c7eb-3077-4cc7-a1bd-beaac26d74b0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:03.296390 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d1d1c7eb-3077-4cc7-a1bd-beaac26d74b0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:03.360195 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6057e821-00fa-486d-88c5-336e56e5a8a4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:03.370290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6057e821-00fa-486d-88c5-336e56e5a8a4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.311079 Jul 12 17:28:03.371353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 134/286] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:03 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:03.377143 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-717e783f-964c-43a7-bc97-010722b8f2f0 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:03.377808 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-717e783f-964c-43a7-bc97-010722b8f2f0 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:03.462120 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-717e783f-964c-43a7-bc97-010722b8f2f0 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:03.475836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-717e783f-964c-43a7-bc97-010722b8f2f0 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1258 microversion: 2.1 time: 0.103385 Jul 12 17:28:03.476917 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 135/287] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:03 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1258 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:03.520708 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d1d1c7eb-3077-4cc7-a1bd-beaac26d74b0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:03.531529 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d1d1c7eb-3077-4cc7-a1bd-beaac26d74b0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:03.533315 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d1d1c7eb-3077-4cc7-a1bd-beaac26d74b0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:03.535565 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d1d1c7eb-3077-4cc7-a1bd-beaac26d74b0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.293424 Jul 12 17:28:03.549122 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 153/288] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:03 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:04.387340 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-26088a7c-ab63-40e5-ae6c-9c44daa30d03 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:04.387951 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-26088a7c-ab63-40e5-ae6c-9c44daa30d03 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:04.390336 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:04.396702 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-26088a7c-ab63-40e5-ae6c-9c44daa30d03 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:04.397162 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-26088a7c-ab63-40e5-ae6c-9c44daa30d03 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:04.397945 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-26088a7c-ab63-40e5-ae6c-9c44daa30d03 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:04.398382 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-26088a7c-ab63-40e5-ae6c-9c44daa30d03 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:04.493093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d97a3d88-7899-4652-9edf-25a879c658ea tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:04.493725 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d97a3d88-7899-4652-9edf-25a879c658ea tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:04.499865 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d97a3d88-7899-4652-9edf-25a879c658ea tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:04.500311 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d97a3d88-7899-4652-9edf-25a879c658ea tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:04.501077 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d97a3d88-7899-4652-9edf-25a879c658ea tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:04.501510 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d97a3d88-7899-4652-9edf-25a879c658ea tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:04.612938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d97a3d88-7899-4652-9edf-25a879c658ea tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:04.616325 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-26088a7c-ab63-40e5-ae6c-9c44daa30d03 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:04.626574 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-26088a7c-ab63-40e5-ae6c-9c44daa30d03 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.242984 Jul 12 17:28:04.627149 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d97a3d88-7899-4652-9edf-25a879c658ea tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1262 microversion: 2.1 time: 0.137843 Jul 12 17:28:04.627727 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 154/289] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:04 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1262 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:04.632621 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5a534b0b-6eb1-48c9-91e8-2b3a681914bf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:04.633158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5a534b0b-6eb1-48c9-91e8-2b3a681914bf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:04.637100 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 136/290] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:04 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:04.642775 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5a534b0b-6eb1-48c9-91e8-2b3a681914bf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:04.643231 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5a534b0b-6eb1-48c9-91e8-2b3a681914bf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:04.644035 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5a534b0b-6eb1-48c9-91e8-2b3a681914bf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:04.644477 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5a534b0b-6eb1-48c9-91e8-2b3a681914bf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:04.779587 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5a534b0b-6eb1-48c9-91e8-2b3a681914bf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:04.782989 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:04.788233 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5a534b0b-6eb1-48c9-91e8-2b3a681914bf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:04.789882 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5a534b0b-6eb1-48c9-91e8-2b3a681914bf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:04.790978 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5a534b0b-6eb1-48c9-91e8-2b3a681914bf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.162078 Jul 12 17:28:04.791770 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 155/291] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:04 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:05.644245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-374ae4d2-90c1-4467-8c32-7aee20fea540 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:05.645422 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-374ae4d2-90c1-4467-8c32-7aee20fea540 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:05.649955 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-93ea6bca-2045-4718-822c-89237f9e4437 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:05.650574 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-93ea6bca-2045-4718-822c-89237f9e4437 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:05.652788 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-374ae4d2-90c1-4467-8c32-7aee20fea540 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:05.653236 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-374ae4d2-90c1-4467-8c32-7aee20fea540 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:05.654031 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-374ae4d2-90c1-4467-8c32-7aee20fea540 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:05.654495 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-374ae4d2-90c1-4467-8c32-7aee20fea540 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:05.657901 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-93ea6bca-2045-4718-822c-89237f9e4437 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:05.658354 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-93ea6bca-2045-4718-822c-89237f9e4437 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:05.659460 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-93ea6bca-2045-4718-822c-89237f9e4437 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:05.659905 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-93ea6bca-2045-4718-822c-89237f9e4437 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:05.745778 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-93ea6bca-2045-4718-822c-89237f9e4437 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:05.756601 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-93ea6bca-2045-4718-822c-89237f9e4437 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1262 microversion: 2.1 time: 0.110804 Jul 12 17:28:05.768984 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 156/292] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:05 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1262 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:05.810331 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f557d132-e575-4fa8-a853-e61c6635deba tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:05.810954 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f557d132-e575-4fa8-a853-e61c6635deba tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:05.817712 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f557d132-e575-4fa8-a853-e61c6635deba tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:05.818247 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f557d132-e575-4fa8-a853-e61c6635deba tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:05.819109 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f557d132-e575-4fa8-a853-e61c6635deba tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:05.819636 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f557d132-e575-4fa8-a853-e61c6635deba tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:05.852632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-374ae4d2-90c1-4467-8c32-7aee20fea540 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:05.861340 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-374ae4d2-90c1-4467-8c32-7aee20fea540 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.220758 Jul 12 17:28:05.862548 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 137/293] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:05 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:05.963044 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f557d132-e575-4fa8-a853-e61c6635deba tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:05.971499 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f557d132-e575-4fa8-a853-e61c6635deba tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:05.973198 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f557d132-e575-4fa8-a853-e61c6635deba tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:05.974419 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f557d132-e575-4fa8-a853-e61c6635deba tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.169421 Jul 12 17:28:05.975176 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 157/294] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:05 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:28:06.776054 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e80fa391-229e-4f41-8397-1a3f426ba1f4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:06.776796 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e80fa391-229e-4f41-8397-1a3f426ba1f4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:06.784429 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e80fa391-229e-4f41-8397-1a3f426ba1f4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:06.784816 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e80fa391-229e-4f41-8397-1a3f426ba1f4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:06.785592 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e80fa391-229e-4f41-8397-1a3f426ba1f4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:06.786072 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e80fa391-229e-4f41-8397-1a3f426ba1f4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:06.849170 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e80fa391-229e-4f41-8397-1a3f426ba1f4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:06.857670 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e80fa391-229e-4f41-8397-1a3f426ba1f4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1262 microversion: 2.1 time: 0.085696 Jul 12 17:28:06.858282 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 138/295] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:06 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:06.879490 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f9c630f9-00f5-4845-aac9-3cbb4b0ef96a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:06.880635 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f9c630f9-00f5-4845-aac9-3cbb4b0ef96a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:06.886835 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f9c630f9-00f5-4845-aac9-3cbb4b0ef96a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:06.887303 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f9c630f9-00f5-4845-aac9-3cbb4b0ef96a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:06.888636 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f9c630f9-00f5-4845-aac9-3cbb4b0ef96a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:06.889067 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f9c630f9-00f5-4845-aac9-3cbb4b0ef96a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:06.993865 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9deec261-1575-4121-aa5a-b3036bbdbec8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:06.994856 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9deec261-1575-4121-aa5a-b3036bbdbec8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:07.002188 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9deec261-1575-4121-aa5a-b3036bbdbec8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:07.002643 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9deec261-1575-4121-aa5a-b3036bbdbec8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:07.003445 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9deec261-1575-4121-aa5a-b3036bbdbec8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:07.003886 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9deec261-1575-4121-aa5a-b3036bbdbec8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:07.025790 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f9c630f9-00f5-4845-aac9-3cbb4b0ef96a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:07.034695 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f9c630f9-00f5-4845-aac9-3cbb4b0ef96a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.159539 Jul 12 17:28:07.035562 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 158/296] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:06 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:07.138967 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9deec261-1575-4121-aa5a-b3036bbdbec8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:07.147180 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9deec261-1575-4121-aa5a-b3036bbdbec8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:07.148758 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9deec261-1575-4121-aa5a-b3036bbdbec8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:07.150083 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9deec261-1575-4121-aa5a-b3036bbdbec8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.161096 Jul 12 17:28:07.150678 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 139/297] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:06 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:07.874860 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f6297264-4366-45fb-84a0-382f948cb6a6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:07.875473 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f6297264-4366-45fb-84a0-382f948cb6a6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:07.882545 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f6297264-4366-45fb-84a0-382f948cb6a6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:07.883215 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f6297264-4366-45fb-84a0-382f948cb6a6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:07.883590 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f6297264-4366-45fb-84a0-382f948cb6a6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:07.884027 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f6297264-4366-45fb-84a0-382f948cb6a6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:08.053447 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b469a41a-e2ea-4a67-8ebc-68b24cd261a9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:08.054739 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b469a41a-e2ea-4a67-8ebc-68b24cd261a9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:08.062517 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b469a41a-e2ea-4a67-8ebc-68b24cd261a9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:08.062983 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b469a41a-e2ea-4a67-8ebc-68b24cd261a9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:08.063943 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b469a41a-e2ea-4a67-8ebc-68b24cd261a9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:08.064381 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b469a41a-e2ea-4a67-8ebc-68b24cd261a9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:08.100308 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f6297264-4366-45fb-84a0-382f948cb6a6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:08.107780 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f6297264-4366-45fb-84a0-382f948cb6a6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1262 microversion: 2.1 time: 0.237382 Jul 12 17:28:08.108351 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 159/298] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:07 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1262 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:08.169006 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8c69bc6d-d176-41cf-80d0-47398f04fe67 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:08.169858 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8c69bc6d-d176-41cf-80d0-47398f04fe67 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:08.177953 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c69bc6d-d176-41cf-80d0-47398f04fe67 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:08.178411 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c69bc6d-d176-41cf-80d0-47398f04fe67 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:08.179312 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c69bc6d-d176-41cf-80d0-47398f04fe67 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:08.179747 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c69bc6d-d176-41cf-80d0-47398f04fe67 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:08.221416 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b469a41a-e2ea-4a67-8ebc-68b24cd261a9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:08.229537 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b469a41a-e2ea-4a67-8ebc-68b24cd261a9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.181011 Jul 12 17:28:08.230346 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 140/299] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:08 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:08.323504 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8c69bc6d-d176-41cf-80d0-47398f04fe67 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:08.332051 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8c69bc6d-d176-41cf-80d0-47398f04fe67 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:08.333569 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8c69bc6d-d176-41cf-80d0-47398f04fe67 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:08.334799 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8c69bc6d-d176-41cf-80d0-47398f04fe67 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.170449 Jul 12 17:28:08.335344 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 160/300] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:08 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:28:09.124404 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-fb267ff5-4343-4e36-ac9a-196b57297335 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:09.125013 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-fb267ff5-4343-4e36-ac9a-196b57297335 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:09.131630 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fb267ff5-4343-4e36-ac9a-196b57297335 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:09.132075 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fb267ff5-4343-4e36-ac9a-196b57297335 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:09.132868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fb267ff5-4343-4e36-ac9a-196b57297335 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:09.133287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fb267ff5-4343-4e36-ac9a-196b57297335 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:09.193621 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fb267ff5-4343-4e36-ac9a-196b57297335 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:09.201497 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-fb267ff5-4343-4e36-ac9a-196b57297335 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1262 microversion: 2.1 time: 0.080959 Jul 12 17:28:09.202095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 141/301] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:09 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:09.246428 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-dd965b53-b14a-493f-8aba-701043dcad13 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:09.247148 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-dd965b53-b14a-493f-8aba-701043dcad13 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:09.253471 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dd965b53-b14a-493f-8aba-701043dcad13 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:09.254288 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dd965b53-b14a-493f-8aba-701043dcad13 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:09.255141 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dd965b53-b14a-493f-8aba-701043dcad13 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:09.255669 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dd965b53-b14a-493f-8aba-701043dcad13 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:09.353271 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-eca6c5f0-9e7d-433f-b1e7-7588b1e89df9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:09.354277 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-eca6c5f0-9e7d-433f-b1e7-7588b1e89df9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:09.363055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eca6c5f0-9e7d-433f-b1e7-7588b1e89df9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:09.363666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eca6c5f0-9e7d-433f-b1e7-7588b1e89df9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:09.364437 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eca6c5f0-9e7d-433f-b1e7-7588b1e89df9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:09.365034 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eca6c5f0-9e7d-433f-b1e7-7588b1e89df9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:09.526052 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-dd965b53-b14a-493f-8aba-701043dcad13 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:09.535392 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-dd965b53-b14a-493f-8aba-701043dcad13 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.292597 Jul 12 17:28:09.536001 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 161/302] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:09 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:09.609396 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-eca6c5f0-9e7d-433f-b1e7-7588b1e89df9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:09.617231 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-eca6c5f0-9e7d-433f-b1e7-7588b1e89df9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:09.618771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-eca6c5f0-9e7d-433f-b1e7-7588b1e89df9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:09.619860 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-eca6c5f0-9e7d-433f-b1e7-7588b1e89df9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.271038 Jul 12 17:28:09.620403 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 142/303] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:09 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:10.217882 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f6cc805b-bb68-4c7d-bedf-d1861d6e0fc6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:10.218482 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f6cc805b-bb68-4c7d-bedf-d1861d6e0fc6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:10.224490 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f6cc805b-bb68-4c7d-bedf-d1861d6e0fc6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:10.224938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f6cc805b-bb68-4c7d-bedf-d1861d6e0fc6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:10.225712 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f6cc805b-bb68-4c7d-bedf-d1861d6e0fc6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:10.226149 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f6cc805b-bb68-4c7d-bedf-d1861d6e0fc6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:10.293017 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f6cc805b-bb68-4c7d-bedf-d1861d6e0fc6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:10.301080 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f6cc805b-bb68-4c7d-bedf-d1861d6e0fc6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1316 microversion: 2.1 time: 0.087323 Jul 12 17:28:10.301644 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 162/304] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:10 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1316 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:10.386585 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4fc2aba5-8cce-40c5-a186-4b1fb3d8da00 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1091901415", "imageRef": "b19e7830-75c9-4706-bd34-4954ba6b4cc1", "flavorRef": "452", "networks": [{"uuid": "faf5a3e6-041b-4d44-8f2e-8f0cc2e1560a"}]}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:28:10.443098 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.network.neutron [None req-4fc2aba5-8cce-40c5-a186-4b1fb3d8da00 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] validate_networks() for [('faf5a3e6-041b-4d44-8f2e-8f0cc2e1560a', None, None, None, None, None)] {{(pid=117939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:28:10.553560 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d2345ae6-20e6-446b-908b-c7cc824dde6b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:10.555241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d2345ae6-20e6-446b-908b-c7cc824dde6b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:10.565528 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d2345ae6-20e6-446b-908b-c7cc824dde6b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:10.566681 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d2345ae6-20e6-446b-908b-c7cc824dde6b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:10.567653 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d2345ae6-20e6-446b-908b-c7cc824dde6b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:10.568242 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d2345ae6-20e6-446b-908b-c7cc824dde6b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:10.881823 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d2345ae6-20e6-446b-908b-c7cc824dde6b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:10.892458 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d2345ae6-20e6-446b-908b-c7cc824dde6b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.341205 Jul 12 17:28:10.893333 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 163/305] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:10 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:10.898852 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-23ba5bce-5033-4044-a45d-801b4fe8c084 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:10.899449 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-23ba5bce-5033-4044-a45d-801b4fe8c084 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:10.917153 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-23ba5bce-5033-4044-a45d-801b4fe8c084 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:10.917643 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-23ba5bce-5033-4044-a45d-801b4fe8c084 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:10.921371 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-23ba5bce-5033-4044-a45d-801b4fe8c084 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:10.922376 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-23ba5bce-5033-4044-a45d-801b4fe8c084 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:11.562068 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-4fc2aba5-8cce-40c5-a186-4b1fb3d8da00 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Flavor limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:28:11.564016 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-4fc2aba5-8cce-40c5-a186-4b1fb3d8da00 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Image limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:28:11.564940 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-4fc2aba5-8cce-40c5-a186-4b1fb3d8da00 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Flavor pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:28:11.565636 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-4fc2aba5-8cce-40c5-a186-4b1fb3d8da00 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Image pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:28:11.566375 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-4fc2aba5-8cce-40c5-a186-4b1fb3d8da00 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:28:11.588691 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4fc2aba5-8cce-40c5-a186-4b1fb3d8da00 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:11.589535 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4fc2aba5-8cce-40c5-a186-4b1fb3d8da00 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:11.590726 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4fc2aba5-8cce-40c5-a186-4b1fb3d8da00 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:11.591553 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4fc2aba5-8cce-40c5-a186-4b1fb3d8da00 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:11.603033 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-23ba5bce-5033-4044-a45d-801b4fe8c084 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:11.611866 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-23ba5bce-5033-4044-a45d-801b4fe8c084 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:11.613452 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-23ba5bce-5033-4044-a45d-801b4fe8c084 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:11.614607 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-23ba5bce-5033-4044-a45d-801b4fe8c084 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.720226 Jul 12 17:28:11.615482 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 164/306] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:10 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:11.620235 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-de614f0a-a808-4c1d-997d-3f668fbb58a6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:11.620839 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-de614f0a-a808-4c1d-997d-3f668fbb58a6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:11.627255 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-4fc2aba5-8cce-40c5-a186-4b1fb3d8da00 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Getting quotas for project fb0d32278a254e65ae2ac38b2c7a8e48. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:28:11.632840 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-4fc2aba5-8cce-40c5-a186-4b1fb3d8da00 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Getting quotas for user be175ae71d25489c82ab8e558a93e003 and project fb0d32278a254e65ae2ac38b2c7a8e48. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:28:11.634081 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-de614f0a-a808-4c1d-997d-3f668fbb58a6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:11.634708 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-de614f0a-a808-4c1d-997d-3f668fbb58a6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:11.635668 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-de614f0a-a808-4c1d-997d-3f668fbb58a6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:11.636257 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-de614f0a-a808-4c1d-997d-3f668fbb58a6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:11.647274 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4fc2aba5-8cce-40c5-a186-4b1fb3d8da00 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Going to run 1 instances... {{(pid=117939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:28:11.649567 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4fc2aba5-8cce-40c5-a186-4b1fb3d8da00 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19e7830-75c9-4706-bd34-4954ba6b4cc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:28:11.714570 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4fc2aba5-8cce-40c5-a186-4b1fb3d8da00 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.333882 Jul 12 17:28:11.721484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 143/307] 10.222.0.62 () {60 vars in 1146 bytes} [Tue Jul 12 17:28:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 17:28:11.736562 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-11db1dd4-768b-420e-adeb-175de1178e85 req-e60ee603-c438-410a-8f86-b6e0345899d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b5e50f-5079-438b-ac33-67623b4428f5", "name": "network-vif-plugged", "status": "completed", "tag": "e0dd8828-dbc7-4d01-9d3f-ee997fb3d5ce"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:28:11.760092 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-11db1dd4-768b-420e-adeb-175de1178e85 req-e60ee603-c438-410a-8f86-b6e0345899d3 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:11.764667 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-11db1dd4-768b-420e-adeb-175de1178e85 req-e60ee603-c438-410a-8f86-b6e0345899d3 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:11.794806 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-11db1dd4-768b-420e-adeb-175de1178e85 req-e60ee603-c438-410a-8f86-b6e0345899d3 service nova] Creating event network-vif-plugged:e0dd8828-dbc7-4d01-9d3f-ee997fb3d5ce for instance 48b5e50f-5079-438b-ac33-67623b4428f5 on hv-cinder-84932 Jul 12 17:28:11.805176 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-11db1dd4-768b-420e-adeb-175de1178e85 req-e60ee603-c438-410a-8f86-b6e0345899d3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082081 Jul 12 17:28:11.807561 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-de614f0a-a808-4c1d-997d-3f668fbb58a6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:11.808714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 144/308] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:28:11.815925 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-be035784-2489-477b-9461-12bf0d612eec tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:11.816628 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-be035784-2489-477b-9461-12bf0d612eec tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:11.823413 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-de614f0a-a808-4c1d-997d-3f668fbb58a6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.206872 Jul 12 17:28:11.824395 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 165/309] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:11 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:11.886351 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-be035784-2489-477b-9461-12bf0d612eec tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:11.900634 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-be035784-2489-477b-9461-12bf0d612eec tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1214 microversion: 2.1 time: 0.089476 Jul 12 17:28:11.901502 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 145/310] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:11 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:11.911233 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5b7aea7f-9933-4e14-8c18-26e598fed98d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:11.911233 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5b7aea7f-9933-4e14-8c18-26e598fed98d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:11.918309 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5b7aea7f-9933-4e14-8c18-26e598fed98d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:11.919510 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5b7aea7f-9933-4e14-8c18-26e598fed98d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:11.921252 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5b7aea7f-9933-4e14-8c18-26e598fed98d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:11.922013 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5b7aea7f-9933-4e14-8c18-26e598fed98d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:12.118027 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5b7aea7f-9933-4e14-8c18-26e598fed98d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:12.126692 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5b7aea7f-9933-4e14-8c18-26e598fed98d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.220631 Jul 12 17:28:12.127957 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 166/311] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:11 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:12.636194 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5d4f6f8f-2b6c-47ef-8193-9cf2b0e4b40a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:12.636801 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5d4f6f8f-2b6c-47ef-8193-9cf2b0e4b40a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:12.644492 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5d4f6f8f-2b6c-47ef-8193-9cf2b0e4b40a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:12.644952 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5d4f6f8f-2b6c-47ef-8193-9cf2b0e4b40a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:12.645737 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5d4f6f8f-2b6c-47ef-8193-9cf2b0e4b40a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:12.646178 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5d4f6f8f-2b6c-47ef-8193-9cf2b0e4b40a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:12.807091 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5d4f6f8f-2b6c-47ef-8193-9cf2b0e4b40a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:12.815865 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5d4f6f8f-2b6c-47ef-8193-9cf2b0e4b40a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:12.817656 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5d4f6f8f-2b6c-47ef-8193-9cf2b0e4b40a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:12.818994 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5d4f6f8f-2b6c-47ef-8193-9cf2b0e4b40a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.186697 Jul 12 17:28:12.820075 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 146/312] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:12 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:12.841820 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-51f70736-83d3-4d49-9b3f-301f985bc5b2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:12.842425 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-51f70736-83d3-4d49-9b3f-301f985bc5b2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:12.848470 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-51f70736-83d3-4d49-9b3f-301f985bc5b2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:12.848913 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-51f70736-83d3-4d49-9b3f-301f985bc5b2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:12.849675 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-51f70736-83d3-4d49-9b3f-301f985bc5b2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:12.850125 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-51f70736-83d3-4d49-9b3f-301f985bc5b2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:12.916811 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-97644dfa-bfa4-4f72-8d3e-872a11250f3a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:12.917721 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-97644dfa-bfa4-4f72-8d3e-872a11250f3a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:12.931404 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-97644dfa-bfa4-4f72-8d3e-872a11250f3a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:12.932129 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-97644dfa-bfa4-4f72-8d3e-872a11250f3a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:12.932889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-97644dfa-bfa4-4f72-8d3e-872a11250f3a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:12.933327 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-97644dfa-bfa4-4f72-8d3e-872a11250f3a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:13.020868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-97644dfa-bfa4-4f72-8d3e-872a11250f3a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:13.024331 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-51f70736-83d3-4d49-9b3f-301f985bc5b2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:13.028457 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-97644dfa-bfa4-4f72-8d3e-872a11250f3a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1218 microversion: 2.1 time: 0.115356 Jul 12 17:28:13.029027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 147/313] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:12 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:13.031951 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-51f70736-83d3-4d49-9b3f-301f985bc5b2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.194099 Jul 12 17:28:13.032591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 167/314] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:12 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:13.144204 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-801713ab-07c0-4166-92d9-69a7cd5c74a3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:13.145278 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-801713ab-07c0-4166-92d9-69a7cd5c74a3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:13.152862 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-801713ab-07c0-4166-92d9-69a7cd5c74a3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:13.153654 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-801713ab-07c0-4166-92d9-69a7cd5c74a3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:13.154664 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-801713ab-07c0-4166-92d9-69a7cd5c74a3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:13.155432 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-801713ab-07c0-4166-92d9-69a7cd5c74a3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:13.325141 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-801713ab-07c0-4166-92d9-69a7cd5c74a3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:13.352682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-801713ab-07c0-4166-92d9-69a7cd5c74a3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.212269 Jul 12 17:28:13.353457 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 148/315] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:13 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:13.839302 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-823fbd4c-a8fb-4a09-b3d8-570d5f2dbdf2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:13.839905 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-823fbd4c-a8fb-4a09-b3d8-570d5f2dbdf2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:13.842303 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=4 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:13.842963 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=12 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:13.849253 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-823fbd4c-a8fb-4a09-b3d8-570d5f2dbdf2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:13.849719 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-823fbd4c-a8fb-4a09-b3d8-570d5f2dbdf2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:13.850484 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-823fbd4c-a8fb-4a09-b3d8-570d5f2dbdf2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:13.850919 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-823fbd4c-a8fb-4a09-b3d8-570d5f2dbdf2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:13.979075 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-823fbd4c-a8fb-4a09-b3d8-570d5f2dbdf2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:13.986874 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-823fbd4c-a8fb-4a09-b3d8-570d5f2dbdf2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:13.988380 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-823fbd4c-a8fb-4a09-b3d8-570d5f2dbdf2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:13.989475 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-823fbd4c-a8fb-4a09-b3d8-570d5f2dbdf2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.154791 Jul 12 17:28:13.990057 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 168/316] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:13 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:14.045239 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f47b621b-8454-4482-97f2-5788d1deb5ff tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:14.045961 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f47b621b-8454-4482-97f2-5788d1deb5ff tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:14.047723 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5cea4fd9-edec-4448-98f5-bc9e50237a30 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:14.048330 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5cea4fd9-edec-4448-98f5-bc9e50237a30 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:14.052630 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f47b621b-8454-4482-97f2-5788d1deb5ff tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:14.053137 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f47b621b-8454-4482-97f2-5788d1deb5ff tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:14.053985 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f47b621b-8454-4482-97f2-5788d1deb5ff tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:14.054138 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5cea4fd9-edec-4448-98f5-bc9e50237a30 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:14.054551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f47b621b-8454-4482-97f2-5788d1deb5ff tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:14.054650 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5cea4fd9-edec-4448-98f5-bc9e50237a30 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:14.055325 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5cea4fd9-edec-4448-98f5-bc9e50237a30 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:14.055753 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5cea4fd9-edec-4448-98f5-bc9e50237a30 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:14.072540 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:14.141051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f47b621b-8454-4482-97f2-5788d1deb5ff tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:14.148345 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f47b621b-8454-4482-97f2-5788d1deb5ff tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1218 microversion: 2.1 time: 0.106888 Jul 12 17:28:14.148911 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 149/317] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:14 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:14.207875 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5cea4fd9-edec-4448-98f5-bc9e50237a30 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:14.215221 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5cea4fd9-edec-4448-98f5-bc9e50237a30 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.171135 Jul 12 17:28:14.216468 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 169/318] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:14 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:14.372884 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a56d810f-8d54-46c8-a820-8b8aa03d0ccf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:14.373497 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a56d810f-8d54-46c8-a820-8b8aa03d0ccf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:14.379602 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a56d810f-8d54-46c8-a820-8b8aa03d0ccf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:14.380051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a56d810f-8d54-46c8-a820-8b8aa03d0ccf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:14.380815 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a56d810f-8d54-46c8-a820-8b8aa03d0ccf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:14.381251 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a56d810f-8d54-46c8-a820-8b8aa03d0ccf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:14.511361 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a56d810f-8d54-46c8-a820-8b8aa03d0ccf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:14.519280 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a56d810f-8d54-46c8-a820-8b8aa03d0ccf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.150794 Jul 12 17:28:14.519836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 150/319] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:14 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:15.008816 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4b34c895-440a-42f9-ad42-5847ce12c1df tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:15.009488 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4b34c895-440a-42f9-ad42-5847ce12c1df tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:15.015677 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4b34c895-440a-42f9-ad42-5847ce12c1df tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:15.016138 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4b34c895-440a-42f9-ad42-5847ce12c1df tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:15.016922 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4b34c895-440a-42f9-ad42-5847ce12c1df tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:15.017353 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4b34c895-440a-42f9-ad42-5847ce12c1df tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:15.167340 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d19b8861-43b9-4f8f-94bc-64ee16279283 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:15.168136 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4b34c895-440a-42f9-ad42-5847ce12c1df tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:15.169193 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d19b8861-43b9-4f8f-94bc-64ee16279283 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:15.175969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d19b8861-43b9-4f8f-94bc-64ee16279283 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:15.176735 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d19b8861-43b9-4f8f-94bc-64ee16279283 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:15.176993 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4b34c895-440a-42f9-ad42-5847ce12c1df tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:15.178032 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d19b8861-43b9-4f8f-94bc-64ee16279283 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:15.178533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4b34c895-440a-42f9-ad42-5847ce12c1df tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:15.179646 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4b34c895-440a-42f9-ad42-5847ce12c1df tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.174952 Jul 12 17:28:15.180580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 170/320] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:15 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:15.181315 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d19b8861-43b9-4f8f-94bc-64ee16279283 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:15.234913 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f0d1cf8c-88cd-4663-bb71-528508c47ab6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:15.235527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f0d1cf8c-88cd-4663-bb71-528508c47ab6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:15.242184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f0d1cf8c-88cd-4663-bb71-528508c47ab6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:15.242898 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f0d1cf8c-88cd-4663-bb71-528508c47ab6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:15.243944 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f0d1cf8c-88cd-4663-bb71-528508c47ab6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:15.244344 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f0d1cf8c-88cd-4663-bb71-528508c47ab6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:15.254712 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d19b8861-43b9-4f8f-94bc-64ee16279283 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:15.261916 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d19b8861-43b9-4f8f-94bc-64ee16279283 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1218 microversion: 2.1 time: 0.098805 Jul 12 17:28:15.262514 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 151/321] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:15 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:15.371273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f0d1cf8c-88cd-4663-bb71-528508c47ab6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:15.378500 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f0d1cf8c-88cd-4663-bb71-528508c47ab6 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.149191 Jul 12 17:28:15.379079 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 171/322] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:15 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:15.536198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-964fc514-b85a-4c4b-941d-6e852773ca82 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:15.536807 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-964fc514-b85a-4c4b-941d-6e852773ca82 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:15.542876 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-964fc514-b85a-4c4b-941d-6e852773ca82 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:15.543329 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-964fc514-b85a-4c4b-941d-6e852773ca82 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:15.544103 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-964fc514-b85a-4c4b-941d-6e852773ca82 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:15.544539 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-964fc514-b85a-4c4b-941d-6e852773ca82 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:15.703669 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-964fc514-b85a-4c4b-941d-6e852773ca82 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:15.711509 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-964fc514-b85a-4c4b-941d-6e852773ca82 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.178880 Jul 12 17:28:15.712071 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 152/323] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:15 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:16.197333 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8c2518a5-9122-4ef2-972f-c010884d7968 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:16.197973 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8c2518a5-9122-4ef2-972f-c010884d7968 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:16.204444 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c2518a5-9122-4ef2-972f-c010884d7968 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:16.204886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c2518a5-9122-4ef2-972f-c010884d7968 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:16.205637 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c2518a5-9122-4ef2-972f-c010884d7968 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:16.206088 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c2518a5-9122-4ef2-972f-c010884d7968 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:16.224093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:16.281339 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e2d55cf2-d486-45ba-b9e5-17a087c7b137 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:16.282795 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e2d55cf2-d486-45ba-b9e5-17a087c7b137 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:16.289771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e2d55cf2-d486-45ba-b9e5-17a087c7b137 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:16.290299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e2d55cf2-d486-45ba-b9e5-17a087c7b137 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:16.291202 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e2d55cf2-d486-45ba-b9e5-17a087c7b137 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:16.291708 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e2d55cf2-d486-45ba-b9e5-17a087c7b137 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:16.368548 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e2d55cf2-d486-45ba-b9e5-17a087c7b137 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:16.373894 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e2d55cf2-d486-45ba-b9e5-17a087c7b137 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1218 microversion: 2.1 time: 0.098885 Jul 12 17:28:16.383667 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8c2518a5-9122-4ef2-972f-c010884d7968 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:16.383917 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 153/324] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:16 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:16.393594 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8c2518a5-9122-4ef2-972f-c010884d7968 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:16.395158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8c2518a5-9122-4ef2-972f-c010884d7968 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:16.396154 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ee82e283-6304-402b-a1bd-e03c07beb261 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:16.396351 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8c2518a5-9122-4ef2-972f-c010884d7968 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.203131 Jul 12 17:28:16.397026 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 172/325] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:16 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:16.397142 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ee82e283-6304-402b-a1bd-e03c07beb261 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:16.404271 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ee82e283-6304-402b-a1bd-e03c07beb261 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:16.404800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ee82e283-6304-402b-a1bd-e03c07beb261 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:16.405644 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ee82e283-6304-402b-a1bd-e03c07beb261 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:16.406297 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ee82e283-6304-402b-a1bd-e03c07beb261 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:16.538641 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ee82e283-6304-402b-a1bd-e03c07beb261 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:16.546174 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ee82e283-6304-402b-a1bd-e03c07beb261 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.154045 Jul 12 17:28:16.546763 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 154/326] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:16 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:16.729961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fe810ec1-f46b-469e-a8fe-46162f63db24 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:16.730601 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fe810ec1-f46b-469e-a8fe-46162f63db24 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:16.736657 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe810ec1-f46b-469e-a8fe-46162f63db24 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:16.737171 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe810ec1-f46b-469e-a8fe-46162f63db24 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:16.738162 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe810ec1-f46b-469e-a8fe-46162f63db24 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:16.738663 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe810ec1-f46b-469e-a8fe-46162f63db24 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:16.882204 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fe810ec1-f46b-469e-a8fe-46162f63db24 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:16.890541 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fe810ec1-f46b-469e-a8fe-46162f63db24 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.164578 Jul 12 17:28:16.891148 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 173/327] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:16 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:17.390766 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b27514aa-01ec-4042-a11a-d02667d7c1b6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:17.391348 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b27514aa-01ec-4042-a11a-d02667d7c1b6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:17.398179 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b27514aa-01ec-4042-a11a-d02667d7c1b6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:17.398635 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b27514aa-01ec-4042-a11a-d02667d7c1b6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:17.399416 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b27514aa-01ec-4042-a11a-d02667d7c1b6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:17.399853 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b27514aa-01ec-4042-a11a-d02667d7c1b6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:17.414910 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-aac4849e-59aa-47d4-aad2-e3d9680eb357 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:17.415597 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-aac4849e-59aa-47d4-aad2-e3d9680eb357 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:17.423629 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aac4849e-59aa-47d4-aad2-e3d9680eb357 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:17.424714 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aac4849e-59aa-47d4-aad2-e3d9680eb357 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:17.425729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aac4849e-59aa-47d4-aad2-e3d9680eb357 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:17.426379 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aac4849e-59aa-47d4-aad2-e3d9680eb357 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:17.484415 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b27514aa-01ec-4042-a11a-d02667d7c1b6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:17.495149 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b27514aa-01ec-4042-a11a-d02667d7c1b6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1218 microversion: 2.1 time: 0.108239 Jul 12 17:28:17.497890 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 155/328] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:17 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:17.565474 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-22d2372a-45a2-4253-b63f-30b7448064db tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:17.566614 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-22d2372a-45a2-4253-b63f-30b7448064db tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:17.574693 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-22d2372a-45a2-4253-b63f-30b7448064db tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:17.575390 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-22d2372a-45a2-4253-b63f-30b7448064db tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:17.576413 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-22d2372a-45a2-4253-b63f-30b7448064db tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:17.576914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-22d2372a-45a2-4253-b63f-30b7448064db tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:17.588508 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-aac4849e-59aa-47d4-aad2-e3d9680eb357 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:17.597712 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-aac4849e-59aa-47d4-aad2-e3d9680eb357 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:17.599261 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-aac4849e-59aa-47d4-aad2-e3d9680eb357 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:17.600400 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-aac4849e-59aa-47d4-aad2-e3d9680eb357 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.189500 Jul 12 17:28:17.601179 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 174/329] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:17 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:28:17.875006 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-22d2372a-45a2-4253-b63f-30b7448064db tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:17.882757 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-22d2372a-45a2-4253-b63f-30b7448064db tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.323295 Jul 12 17:28:17.883329 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 156/330] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:17 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:17.907300 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c5075e25-597e-4d4b-8144-e437caf44f52 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:17.907948 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c5075e25-597e-4d4b-8144-e437caf44f52 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:17.914038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c5075e25-597e-4d4b-8144-e437caf44f52 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:17.914497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c5075e25-597e-4d4b-8144-e437caf44f52 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:17.915250 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c5075e25-597e-4d4b-8144-e437caf44f52 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:17.915682 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c5075e25-597e-4d4b-8144-e437caf44f52 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:18.062346 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c5075e25-597e-4d4b-8144-e437caf44f52 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:18.077466 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c5075e25-597e-4d4b-8144-e437caf44f52 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.167815 Jul 12 17:28:18.078399 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 175/331] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:17 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:18.512091 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-959f2eb3-e91d-4faf-b5fe-4ff4d97aa4b6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:18.512821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-959f2eb3-e91d-4faf-b5fe-4ff4d97aa4b6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:18.519363 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-959f2eb3-e91d-4faf-b5fe-4ff4d97aa4b6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:18.519809 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-959f2eb3-e91d-4faf-b5fe-4ff4d97aa4b6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:18.520580 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-959f2eb3-e91d-4faf-b5fe-4ff4d97aa4b6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:18.521007 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-959f2eb3-e91d-4faf-b5fe-4ff4d97aa4b6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:18.583903 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-959f2eb3-e91d-4faf-b5fe-4ff4d97aa4b6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:18.591165 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-959f2eb3-e91d-4faf-b5fe-4ff4d97aa4b6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1218 microversion: 2.1 time: 0.083036 Jul 12 17:28:18.591714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 157/332] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:18 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:18.619498 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c5898916-a069-4e6a-a59b-754ec5abd1ba tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:18.620108 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c5898916-a069-4e6a-a59b-754ec5abd1ba tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:18.626745 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c5898916-a069-4e6a-a59b-754ec5abd1ba tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:18.627199 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c5898916-a069-4e6a-a59b-754ec5abd1ba tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:18.627963 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c5898916-a069-4e6a-a59b-754ec5abd1ba tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:18.628399 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c5898916-a069-4e6a-a59b-754ec5abd1ba tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:18.753760 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c5898916-a069-4e6a-a59b-754ec5abd1ba tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:18.761620 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c5898916-a069-4e6a-a59b-754ec5abd1ba tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:18.763258 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c5898916-a069-4e6a-a59b-754ec5abd1ba tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:18.764312 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c5898916-a069-4e6a-a59b-754ec5abd1ba tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.148782 Jul 12 17:28:18.764868 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 176/333] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:18 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:18.899554 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-edc0b274-97a1-4506-b8af-7bf2eafcc968 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:18.900340 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-edc0b274-97a1-4506-b8af-7bf2eafcc968 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:18.906741 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-edc0b274-97a1-4506-b8af-7bf2eafcc968 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:18.907183 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-edc0b274-97a1-4506-b8af-7bf2eafcc968 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:18.907938 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-edc0b274-97a1-4506-b8af-7bf2eafcc968 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:18.908366 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-edc0b274-97a1-4506-b8af-7bf2eafcc968 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:19.036095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-edc0b274-97a1-4506-b8af-7bf2eafcc968 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:19.044025 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-edc0b274-97a1-4506-b8af-7bf2eafcc968 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.147649 Jul 12 17:28:19.044579 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 158/334] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:18 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:19.094723 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a107c59b-7ec2-443f-842c-0043b994ade4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:19.095332 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a107c59b-7ec2-443f-842c-0043b994ade4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:19.101189 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a107c59b-7ec2-443f-842c-0043b994ade4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:19.101640 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a107c59b-7ec2-443f-842c-0043b994ade4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:19.102430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a107c59b-7ec2-443f-842c-0043b994ade4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:19.102869 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a107c59b-7ec2-443f-842c-0043b994ade4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:19.228658 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a107c59b-7ec2-443f-842c-0043b994ade4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:19.236017 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a107c59b-7ec2-443f-842c-0043b994ade4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.145670 Jul 12 17:28:19.236588 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 177/335] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:19 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:19.607205 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f6db7e23-0c8b-43a6-899c-5a8d74b22b60 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:19.607802 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f6db7e23-0c8b-43a6-899c-5a8d74b22b60 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:19.614265 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f6db7e23-0c8b-43a6-899c-5a8d74b22b60 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:19.614711 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f6db7e23-0c8b-43a6-899c-5a8d74b22b60 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:19.615472 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f6db7e23-0c8b-43a6-899c-5a8d74b22b60 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:19.615907 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f6db7e23-0c8b-43a6-899c-5a8d74b22b60 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:19.678397 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f6db7e23-0c8b-43a6-899c-5a8d74b22b60 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:19.686089 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f6db7e23-0c8b-43a6-899c-5a8d74b22b60 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1218 microversion: 2.1 time: 0.082747 Jul 12 17:28:19.686639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 159/336] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:19 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:19.782194 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-601f02ca-5e90-4631-a48b-fb7b4b40bb36 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:19.782952 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-601f02ca-5e90-4631-a48b-fb7b4b40bb36 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:19.789450 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-601f02ca-5e90-4631-a48b-fb7b4b40bb36 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:19.790044 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-601f02ca-5e90-4631-a48b-fb7b4b40bb36 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:19.790918 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-601f02ca-5e90-4631-a48b-fb7b4b40bb36 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:19.791544 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-601f02ca-5e90-4631-a48b-fb7b4b40bb36 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:19.932844 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-601f02ca-5e90-4631-a48b-fb7b4b40bb36 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:19.941252 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-601f02ca-5e90-4631-a48b-fb7b4b40bb36 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:19.951496 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-601f02ca-5e90-4631-a48b-fb7b4b40bb36 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:19.952393 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-601f02ca-5e90-4631-a48b-fb7b4b40bb36 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.174143 Jul 12 17:28:19.962530 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 178/337] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:19 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:20.060799 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-729d9dba-c2a9-4243-a48a-f41ec73c4aad tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:20.061875 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-729d9dba-c2a9-4243-a48a-f41ec73c4aad tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:20.068469 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-729d9dba-c2a9-4243-a48a-f41ec73c4aad tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:20.069018 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-729d9dba-c2a9-4243-a48a-f41ec73c4aad tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:20.070088 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-729d9dba-c2a9-4243-a48a-f41ec73c4aad tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:20.070614 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-729d9dba-c2a9-4243-a48a-f41ec73c4aad tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:20.213347 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-729d9dba-c2a9-4243-a48a-f41ec73c4aad tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:20.221167 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-729d9dba-c2a9-4243-a48a-f41ec73c4aad tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.164442 Jul 12 17:28:20.221868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 160/338] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:20 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:20.255452 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8223ad14-9c1f-49ba-903e-6894e5768bc3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:20.256482 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8223ad14-9c1f-49ba-903e-6894e5768bc3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:20.264212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8223ad14-9c1f-49ba-903e-6894e5768bc3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:20.264815 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8223ad14-9c1f-49ba-903e-6894e5768bc3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:20.265595 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8223ad14-9c1f-49ba-903e-6894e5768bc3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:20.266063 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8223ad14-9c1f-49ba-903e-6894e5768bc3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:20.408635 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8223ad14-9c1f-49ba-903e-6894e5768bc3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:20.416387 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8223ad14-9c1f-49ba-903e-6894e5768bc3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.165743 Jul 12 17:28:20.416970 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 179/339] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:20 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:20.704299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4e7540fc-8b9e-45da-853a-869da27639f4 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:20.705562 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4e7540fc-8b9e-45da-853a-869da27639f4 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:20.712436 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4e7540fc-8b9e-45da-853a-869da27639f4 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:20.712883 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4e7540fc-8b9e-45da-853a-869da27639f4 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:20.713658 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4e7540fc-8b9e-45da-853a-869da27639f4 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:20.714131 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4e7540fc-8b9e-45da-853a-869da27639f4 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:20.779079 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4e7540fc-8b9e-45da-853a-869da27639f4 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:20.786546 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4e7540fc-8b9e-45da-853a-869da27639f4 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1218 microversion: 2.1 time: 0.086822 Jul 12 17:28:20.787095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 161/340] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:20 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:20.971315 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-34a56cd4-3fa1-4787-8426-fffaca2377bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:20.971953 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-34a56cd4-3fa1-4787-8426-fffaca2377bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:20.978341 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-34a56cd4-3fa1-4787-8426-fffaca2377bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:20.978792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-34a56cd4-3fa1-4787-8426-fffaca2377bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:20.979551 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-34a56cd4-3fa1-4787-8426-fffaca2377bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:20.979986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-34a56cd4-3fa1-4787-8426-fffaca2377bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:21.108668 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-34a56cd4-3fa1-4787-8426-fffaca2377bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:21.116522 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-34a56cd4-3fa1-4787-8426-fffaca2377bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:21.118070 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-34a56cd4-3fa1-4787-8426-fffaca2377bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:21.119156 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-34a56cd4-3fa1-4787-8426-fffaca2377bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.152383 Jul 12 17:28:21.119701 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 180/341] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:20 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:21.237807 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3eb87349-5de4-4593-907f-3e2f6940bdb9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:21.238508 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3eb87349-5de4-4593-907f-3e2f6940bdb9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:21.244327 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3eb87349-5de4-4593-907f-3e2f6940bdb9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:21.244767 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3eb87349-5de4-4593-907f-3e2f6940bdb9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:21.245519 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3eb87349-5de4-4593-907f-3e2f6940bdb9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:21.245974 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3eb87349-5de4-4593-907f-3e2f6940bdb9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:21.376133 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3eb87349-5de4-4593-907f-3e2f6940bdb9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:21.383400 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3eb87349-5de4-4593-907f-3e2f6940bdb9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.149592 Jul 12 17:28:21.383957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 162/342] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:21 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:21.433575 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-178d4fb2-c71d-4bc2-9448-2601b6d9d2aa tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:21.434301 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-178d4fb2-c71d-4bc2-9448-2601b6d9d2aa tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:21.440124 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-178d4fb2-c71d-4bc2-9448-2601b6d9d2aa tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:21.440577 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-178d4fb2-c71d-4bc2-9448-2601b6d9d2aa tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:21.441335 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-178d4fb2-c71d-4bc2-9448-2601b6d9d2aa tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:21.441832 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-178d4fb2-c71d-4bc2-9448-2601b6d9d2aa tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:21.580758 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-178d4fb2-c71d-4bc2-9448-2601b6d9d2aa tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:21.589235 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-178d4fb2-c71d-4bc2-9448-2601b6d9d2aa tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.159498 Jul 12 17:28:21.590173 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 181/343] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:21 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:21.803888 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e0e0a56f-2e41-4420-9bbf-79c15aa6a303 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:21.804533 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e0e0a56f-2e41-4420-9bbf-79c15aa6a303 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:21.806432 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:21.812837 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e0e0a56f-2e41-4420-9bbf-79c15aa6a303 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:21.813302 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e0e0a56f-2e41-4420-9bbf-79c15aa6a303 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:21.814087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e0e0a56f-2e41-4420-9bbf-79c15aa6a303 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:21.814526 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e0e0a56f-2e41-4420-9bbf-79c15aa6a303 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:21.877836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e0e0a56f-2e41-4420-9bbf-79c15aa6a303 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:21.885050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e0e0a56f-2e41-4420-9bbf-79c15aa6a303 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1218 microversion: 2.1 time: 0.085096 Jul 12 17:28:21.885604 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 163/344] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:21 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:22.136663 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e41c6d4d-a315-426e-900c-6d563b5bb02b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:22.137339 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e41c6d4d-a315-426e-900c-6d563b5bb02b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:22.143684 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e41c6d4d-a315-426e-900c-6d563b5bb02b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:22.144137 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e41c6d4d-a315-426e-900c-6d563b5bb02b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:22.144905 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e41c6d4d-a315-426e-900c-6d563b5bb02b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:22.145338 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e41c6d4d-a315-426e-900c-6d563b5bb02b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:22.291862 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e41c6d4d-a315-426e-900c-6d563b5bb02b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:22.300974 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e41c6d4d-a315-426e-900c-6d563b5bb02b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:22.302660 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e41c6d4d-a315-426e-900c-6d563b5bb02b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:22.303888 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e41c6d4d-a315-426e-900c-6d563b5bb02b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.171161 Jul 12 17:28:22.304551 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 182/345] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:22 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:22.400502 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-50ed2a9c-6237-48eb-bc13-4ad062799cde tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:22.401118 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-50ed2a9c-6237-48eb-bc13-4ad062799cde tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:22.403177 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=20 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:22.408919 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-50ed2a9c-6237-48eb-bc13-4ad062799cde tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:22.409366 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-50ed2a9c-6237-48eb-bc13-4ad062799cde tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:22.410173 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-50ed2a9c-6237-48eb-bc13-4ad062799cde tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:22.410615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-50ed2a9c-6237-48eb-bc13-4ad062799cde tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:22.540248 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-50ed2a9c-6237-48eb-bc13-4ad062799cde tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:22.548124 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-50ed2a9c-6237-48eb-bc13-4ad062799cde tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.151487 Jul 12 17:28:22.548683 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 164/346] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:22 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:22.607666 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-49c9b062-3829-4f06-8d95-27cd112d6d3a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:22.608303 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-49c9b062-3829-4f06-8d95-27cd112d6d3a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:22.614200 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-49c9b062-3829-4f06-8d95-27cd112d6d3a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:22.614648 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-49c9b062-3829-4f06-8d95-27cd112d6d3a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:22.615391 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-49c9b062-3829-4f06-8d95-27cd112d6d3a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:22.615816 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-49c9b062-3829-4f06-8d95-27cd112d6d3a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:22.746190 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-49c9b062-3829-4f06-8d95-27cd112d6d3a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:22.753677 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-49c9b062-3829-4f06-8d95-27cd112d6d3a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.150617 Jul 12 17:28:22.754261 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 183/347] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:22 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:22.902551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1a16c6c6-183b-4d27-ae61-8d68df98b182 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:22.903697 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1a16c6c6-183b-4d27-ae61-8d68df98b182 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:22.910164 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1a16c6c6-183b-4d27-ae61-8d68df98b182 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:22.910614 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1a16c6c6-183b-4d27-ae61-8d68df98b182 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:22.911379 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1a16c6c6-183b-4d27-ae61-8d68df98b182 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:22.911819 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1a16c6c6-183b-4d27-ae61-8d68df98b182 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:22.972453 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1a16c6c6-183b-4d27-ae61-8d68df98b182 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:22.980424 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1a16c6c6-183b-4d27-ae61-8d68df98b182 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1218 microversion: 2.1 time: 0.081839 Jul 12 17:28:22.980985 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 165/348] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:22 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:23.322888 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-188ff53b-b3b8-40ad-9a43-81c17eb1694f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:23.323489 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-188ff53b-b3b8-40ad-9a43-81c17eb1694f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:23.330138 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-188ff53b-b3b8-40ad-9a43-81c17eb1694f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:23.330583 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-188ff53b-b3b8-40ad-9a43-81c17eb1694f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:23.331328 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-188ff53b-b3b8-40ad-9a43-81c17eb1694f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:23.331758 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-188ff53b-b3b8-40ad-9a43-81c17eb1694f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:23.455493 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-188ff53b-b3b8-40ad-9a43-81c17eb1694f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:23.463315 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-188ff53b-b3b8-40ad-9a43-81c17eb1694f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:23.464836 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-188ff53b-b3b8-40ad-9a43-81c17eb1694f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:23.465936 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-188ff53b-b3b8-40ad-9a43-81c17eb1694f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.147167 Jul 12 17:28:23.466496 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 184/349] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:23 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:23.565554 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-818de32b-7bf1-4c83-be44-28074a347d6e tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:23.566279 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-818de32b-7bf1-4c83-be44-28074a347d6e tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:23.572799 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-818de32b-7bf1-4c83-be44-28074a347d6e tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:23.573237 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-818de32b-7bf1-4c83-be44-28074a347d6e tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:23.574017 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-818de32b-7bf1-4c83-be44-28074a347d6e tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:23.574535 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-818de32b-7bf1-4c83-be44-28074a347d6e tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:23.579111 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:23.706882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-818de32b-7bf1-4c83-be44-28074a347d6e tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:23.714698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-818de32b-7bf1-4c83-be44-28074a347d6e tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.153450 Jul 12 17:28:23.715261 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 166/350] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:23 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:23.770111 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-90bf67a3-3491-4487-af6c-7d685837c5f7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:23.770747 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-90bf67a3-3491-4487-af6c-7d685837c5f7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:23.776728 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-90bf67a3-3491-4487-af6c-7d685837c5f7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:23.777175 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-90bf67a3-3491-4487-af6c-7d685837c5f7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:23.777964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-90bf67a3-3491-4487-af6c-7d685837c5f7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:23.778402 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-90bf67a3-3491-4487-af6c-7d685837c5f7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:23.906069 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-90bf67a3-3491-4487-af6c-7d685837c5f7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:23.913451 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-90bf67a3-3491-4487-af6c-7d685837c5f7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.147156 Jul 12 17:28:23.914046 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 185/351] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:23 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:23.996192 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e55146f7-4577-4b85-934a-539bff3cc7bb tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:23.996808 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e55146f7-4577-4b85-934a-539bff3cc7bb tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:24.002947 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e55146f7-4577-4b85-934a-539bff3cc7bb tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:24.003401 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e55146f7-4577-4b85-934a-539bff3cc7bb tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:24.004171 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e55146f7-4577-4b85-934a-539bff3cc7bb tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:24.004608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e55146f7-4577-4b85-934a-539bff3cc7bb tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:24.067060 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e55146f7-4577-4b85-934a-539bff3cc7bb tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:24.074761 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e55146f7-4577-4b85-934a-539bff3cc7bb tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1218 microversion: 2.1 time: 0.082418 Jul 12 17:28:24.075323 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 167/352] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:23 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:24.483348 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-37e95204-516d-45c0-b7a4-a11af14fc779 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:24.483957 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-37e95204-516d-45c0-b7a4-a11af14fc779 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:24.489909 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37e95204-516d-45c0-b7a4-a11af14fc779 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:24.490357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37e95204-516d-45c0-b7a4-a11af14fc779 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:24.491113 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37e95204-516d-45c0-b7a4-a11af14fc779 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:24.491546 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37e95204-516d-45c0-b7a4-a11af14fc779 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:24.619190 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-37e95204-516d-45c0-b7a4-a11af14fc779 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:24.627007 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-37e95204-516d-45c0-b7a4-a11af14fc779 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:24.628511 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-37e95204-516d-45c0-b7a4-a11af14fc779 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:24.629632 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-37e95204-516d-45c0-b7a4-a11af14fc779 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.150115 Jul 12 17:28:24.630207 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 186/353] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:24 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:24.731261 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2256a532-f223-44d7-8053-a07a8d26187a tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:24.731898 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2256a532-f223-44d7-8053-a07a8d26187a tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:24.737799 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2256a532-f223-44d7-8053-a07a8d26187a tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:24.738244 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2256a532-f223-44d7-8053-a07a8d26187a tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:24.739002 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2256a532-f223-44d7-8053-a07a8d26187a tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:24.739432 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2256a532-f223-44d7-8053-a07a8d26187a tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:24.869600 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2256a532-f223-44d7-8053-a07a8d26187a tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:24.877659 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2256a532-f223-44d7-8053-a07a8d26187a tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.150289 Jul 12 17:28:24.878260 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 168/354] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:24 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:24.931300 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b87389c1-0675-4924-9000-907057398b04 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:24.931991 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b87389c1-0675-4924-9000-907057398b04 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:24.938818 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b87389c1-0675-4924-9000-907057398b04 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:24.939350 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b87389c1-0675-4924-9000-907057398b04 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:24.940429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b87389c1-0675-4924-9000-907057398b04 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:24.940723 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b87389c1-0675-4924-9000-907057398b04 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:25.090890 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b87389c1-0675-4924-9000-907057398b04 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:25.092026 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-88bc545a-1695-4800-b8b9-bfdb2195fc34 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:25.092648 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-88bc545a-1695-4800-b8b9-bfdb2195fc34 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:25.099423 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b87389c1-0675-4924-9000-907057398b04 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.172195 Jul 12 17:28:25.100202 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 187/355] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:24 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:25.114330 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-88bc545a-1695-4800-b8b9-bfdb2195fc34 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:25.114904 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-88bc545a-1695-4800-b8b9-bfdb2195fc34 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:25.116262 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-88bc545a-1695-4800-b8b9-bfdb2195fc34 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:25.117124 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-88bc545a-1695-4800-b8b9-bfdb2195fc34 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:25.229649 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-88bc545a-1695-4800-b8b9-bfdb2195fc34 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:25.240179 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-88bc545a-1695-4800-b8b9-bfdb2195fc34 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1210 microversion: 2.1 time: 0.151913 Jul 12 17:28:25.240782 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 169/356] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:25 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1210 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:25.415005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-5966ffd5-2ac0-4a55-b6c3-eb269a208121 req-6422d9ec-2639-4880-ace3-8d066a2b719a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad9cb42e-ab4c-4156-8944-5c8ddd677b0f", "tag": "e5729bfd-6f0d-43dc-88e8-b8b9b0480a96"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:28:25.427982 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-5966ffd5-2ac0-4a55-b6c3-eb269a208121 req-6422d9ec-2639-4880-ace3-8d066a2b719a service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:25.428429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-5966ffd5-2ac0-4a55-b6c3-eb269a208121 req-6422d9ec-2639-4880-ace3-8d066a2b719a service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:25.450711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-5966ffd5-2ac0-4a55-b6c3-eb269a208121 req-6422d9ec-2639-4880-ace3-8d066a2b719a service nova] Creating event network-changed:e5729bfd-6f0d-43dc-88e8-b8b9b0480a96 for instance ad9cb42e-ab4c-4156-8944-5c8ddd677b0f on hv-cinder-84932 Jul 12 17:28:25.455797 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-5966ffd5-2ac0-4a55-b6c3-eb269a208121 req-6422d9ec-2639-4880-ace3-8d066a2b719a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045054 Jul 12 17:28:25.456400 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 188/357] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:28:25.647687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d2579e91-4ffb-447b-a2ca-7759f58e6442 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:25.648288 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d2579e91-4ffb-447b-a2ca-7759f58e6442 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:25.655341 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d2579e91-4ffb-447b-a2ca-7759f58e6442 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:25.655782 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d2579e91-4ffb-447b-a2ca-7759f58e6442 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:25.656534 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d2579e91-4ffb-447b-a2ca-7759f58e6442 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:25.656961 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d2579e91-4ffb-447b-a2ca-7759f58e6442 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:25.795347 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d2579e91-4ffb-447b-a2ca-7759f58e6442 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:25.804957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d2579e91-4ffb-447b-a2ca-7759f58e6442 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:25.806515 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d2579e91-4ffb-447b-a2ca-7759f58e6442 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:25.807656 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d2579e91-4ffb-447b-a2ca-7759f58e6442 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.163900 Jul 12 17:28:25.808340 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 170/358] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:25 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:25.894674 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ee4f95d9-ce77-4fd1-8d28-9e04cab016c4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:25.895371 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ee4f95d9-ce77-4fd1-8d28-9e04cab016c4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:25.901592 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ee4f95d9-ce77-4fd1-8d28-9e04cab016c4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:25.902120 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ee4f95d9-ce77-4fd1-8d28-9e04cab016c4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:25.903420 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ee4f95d9-ce77-4fd1-8d28-9e04cab016c4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:25.903854 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ee4f95d9-ce77-4fd1-8d28-9e04cab016c4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:26.029608 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ee4f95d9-ce77-4fd1-8d28-9e04cab016c4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:26.033028 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:26.037725 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ee4f95d9-ce77-4fd1-8d28-9e04cab016c4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.147285 Jul 12 17:28:26.038290 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 189/359] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:25 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:26.119762 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ea13ea68-39c6-459f-b725-3c8ec92fd12d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:26.120366 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ea13ea68-39c6-459f-b725-3c8ec92fd12d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:26.126710 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ea13ea68-39c6-459f-b725-3c8ec92fd12d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:26.127157 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ea13ea68-39c6-459f-b725-3c8ec92fd12d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:26.127917 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ea13ea68-39c6-459f-b725-3c8ec92fd12d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:26.128346 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ea13ea68-39c6-459f-b725-3c8ec92fd12d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:26.257096 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ea13ea68-39c6-459f-b725-3c8ec92fd12d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:26.257849 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e6570a6e-d2b3-412b-b26a-e7aa757ae550 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:26.258461 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e6570a6e-d2b3-412b-b26a-e7aa757ae550 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:26.264987 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ea13ea68-39c6-459f-b725-3c8ec92fd12d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.149104 Jul 12 17:28:26.265206 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e6570a6e-d2b3-412b-b26a-e7aa757ae550 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:26.265549 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 171/360] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:26 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:26.265731 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e6570a6e-d2b3-412b-b26a-e7aa757ae550 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:26.266562 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e6570a6e-d2b3-412b-b26a-e7aa757ae550 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:26.266992 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e6570a6e-d2b3-412b-b26a-e7aa757ae550 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:26.327236 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e6570a6e-d2b3-412b-b26a-e7aa757ae550 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:26.334621 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e6570a6e-d2b3-412b-b26a-e7aa757ae550 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1266 microversion: 2.1 time: 0.080681 Jul 12 17:28:26.335196 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 190/361] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:26 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:26.826162 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ce318228-11ce-4b7a-ab89-90e2de734b83 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:26.826770 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ce318228-11ce-4b7a-ab89-90e2de734b83 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:26.832727 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ce318228-11ce-4b7a-ab89-90e2de734b83 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:26.833176 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ce318228-11ce-4b7a-ab89-90e2de734b83 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:26.833972 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ce318228-11ce-4b7a-ab89-90e2de734b83 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:26.834416 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ce318228-11ce-4b7a-ab89-90e2de734b83 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:26.963540 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ce318228-11ce-4b7a-ab89-90e2de734b83 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:26.971816 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ce318228-11ce-4b7a-ab89-90e2de734b83 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:26.973333 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ce318228-11ce-4b7a-ab89-90e2de734b83 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:26.974469 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ce318228-11ce-4b7a-ab89-90e2de734b83 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.152270 Jul 12 17:28:26.975024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 172/362] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:26 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:27.054011 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d4470ede-8e7d-4519-94e2-a6c786d21807 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:27.054621 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d4470ede-8e7d-4519-94e2-a6c786d21807 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:27.060625 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d4470ede-8e7d-4519-94e2-a6c786d21807 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:27.061071 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d4470ede-8e7d-4519-94e2-a6c786d21807 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:27.061918 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d4470ede-8e7d-4519-94e2-a6c786d21807 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:27.062349 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d4470ede-8e7d-4519-94e2-a6c786d21807 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:27.189438 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d4470ede-8e7d-4519-94e2-a6c786d21807 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:27.197654 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d4470ede-8e7d-4519-94e2-a6c786d21807 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.147400 Jul 12 17:28:27.198321 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 191/363] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:27 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:27.282013 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-53468158-3b40-4f78-a437-bedf2d1a2524 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:27.282621 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-53468158-3b40-4f78-a437-bedf2d1a2524 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:27.289112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-53468158-3b40-4f78-a437-bedf2d1a2524 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:27.289357 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-53468158-3b40-4f78-a437-bedf2d1a2524 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:27.290148 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-53468158-3b40-4f78-a437-bedf2d1a2524 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:27.290580 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-53468158-3b40-4f78-a437-bedf2d1a2524 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:27.351124 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e0967d57-84a5-4db3-b460-46196bb36d2b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:27.351729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e0967d57-84a5-4db3-b460-46196bb36d2b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:27.358230 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0967d57-84a5-4db3-b460-46196bb36d2b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:27.358671 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0967d57-84a5-4db3-b460-46196bb36d2b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:27.359479 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0967d57-84a5-4db3-b460-46196bb36d2b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:27.359909 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0967d57-84a5-4db3-b460-46196bb36d2b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:27.426478 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e0967d57-84a5-4db3-b460-46196bb36d2b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:27.433576 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e0967d57-84a5-4db3-b460-46196bb36d2b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1266 microversion: 2.1 time: 0.086292 Jul 12 17:28:27.434178 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 192/364] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:27 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:27.442373 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-53468158-3b40-4f78-a437-bedf2d1a2524 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:27.450648 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-53468158-3b40-4f78-a437-bedf2d1a2524 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.172971 Jul 12 17:28:27.451209 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 173/365] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:27 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:27.992477 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d78e3a02-0435-4b7b-896a-bb9cc7c8aeeb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:27.993401 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d78e3a02-0435-4b7b-896a-bb9cc7c8aeeb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:28.000308 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d78e3a02-0435-4b7b-896a-bb9cc7c8aeeb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:28.001021 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d78e3a02-0435-4b7b-896a-bb9cc7c8aeeb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:28.001881 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d78e3a02-0435-4b7b-896a-bb9cc7c8aeeb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:28.002406 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d78e3a02-0435-4b7b-896a-bb9cc7c8aeeb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:28.134511 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d78e3a02-0435-4b7b-896a-bb9cc7c8aeeb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:28.142409 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d78e3a02-0435-4b7b-896a-bb9cc7c8aeeb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:28.143918 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d78e3a02-0435-4b7b-896a-bb9cc7c8aeeb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:28.145017 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d78e3a02-0435-4b7b-896a-bb9cc7c8aeeb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.156528 Jul 12 17:28:28.145574 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 193/366] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:27 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:28.214005 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5aaeb0cf-2745-4e65-a81a-888b17c5eaa9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:28.214614 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5aaeb0cf-2745-4e65-a81a-888b17c5eaa9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:28.220568 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5aaeb0cf-2745-4e65-a81a-888b17c5eaa9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:28.221014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5aaeb0cf-2745-4e65-a81a-888b17c5eaa9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:28.221805 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5aaeb0cf-2745-4e65-a81a-888b17c5eaa9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:28.222243 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5aaeb0cf-2745-4e65-a81a-888b17c5eaa9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:28.344228 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5aaeb0cf-2745-4e65-a81a-888b17c5eaa9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:28.351499 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5aaeb0cf-2745-4e65-a81a-888b17c5eaa9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.141310 Jul 12 17:28:28.352056 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 174/367] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:28 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:28.450293 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3f758764-a50d-4090-8b08-a4bbffadf1c3 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:28.450893 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3f758764-a50d-4090-8b08-a4bbffadf1c3 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:28.456826 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3f758764-a50d-4090-8b08-a4bbffadf1c3 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:28.457265 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3f758764-a50d-4090-8b08-a4bbffadf1c3 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:28.458040 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3f758764-a50d-4090-8b08-a4bbffadf1c3 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:28.458468 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3f758764-a50d-4090-8b08-a4bbffadf1c3 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:28.467522 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-63c4828a-adf9-49c6-a5be-dec20b9325ee tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:28.468131 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-63c4828a-adf9-49c6-a5be-dec20b9325ee tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:28.475150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-63c4828a-adf9-49c6-a5be-dec20b9325ee tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:28.475600 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-63c4828a-adf9-49c6-a5be-dec20b9325ee tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:28.476370 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-63c4828a-adf9-49c6-a5be-dec20b9325ee tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:28.476801 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-63c4828a-adf9-49c6-a5be-dec20b9325ee tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:28.521679 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3f758764-a50d-4090-8b08-a4bbffadf1c3 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:28.529392 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3f758764-a50d-4090-8b08-a4bbffadf1c3 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1266 microversion: 2.1 time: 0.083246 Jul 12 17:28:28.530035 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 194/368] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:28 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:28.617969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-63c4828a-adf9-49c6-a5be-dec20b9325ee tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:28.625365 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-63c4828a-adf9-49c6-a5be-dec20b9325ee tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.162195 Jul 12 17:28:28.625952 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 175/369] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:28 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:29.162792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fea99cc1-3bd8-4b3a-b079-2f2adb4a546a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:29.163398 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fea99cc1-3bd8-4b3a-b079-2f2adb4a546a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:29.165216 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:29.171265 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fea99cc1-3bd8-4b3a-b079-2f2adb4a546a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:29.171708 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fea99cc1-3bd8-4b3a-b079-2f2adb4a546a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:29.172455 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fea99cc1-3bd8-4b3a-b079-2f2adb4a546a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:29.172884 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fea99cc1-3bd8-4b3a-b079-2f2adb4a546a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:29.298284 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fea99cc1-3bd8-4b3a-b079-2f2adb4a546a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:29.305970 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fea99cc1-3bd8-4b3a-b079-2f2adb4a546a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:29.307485 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fea99cc1-3bd8-4b3a-b079-2f2adb4a546a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:29.308557 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fea99cc1-3bd8-4b3a-b079-2f2adb4a546a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.149698 Jul 12 17:28:29.309106 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 195/370] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:29 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:29.368179 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0a9e241e-79c7-46a5-a014-95880804271b tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:29.368782 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0a9e241e-79c7-46a5-a014-95880804271b tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:29.375132 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0a9e241e-79c7-46a5-a014-95880804271b tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:29.375573 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0a9e241e-79c7-46a5-a014-95880804271b tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:29.376325 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0a9e241e-79c7-46a5-a014-95880804271b tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:29.376751 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0a9e241e-79c7-46a5-a014-95880804271b tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:29.503849 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0a9e241e-79c7-46a5-a014-95880804271b tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:29.511100 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0a9e241e-79c7-46a5-a014-95880804271b tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.146779 Jul 12 17:28:29.511653 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 176/371] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:29 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:29.546475 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c4e4feb5-403b-4380-9ece-fbf5ebe0b3f6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:29.547087 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c4e4feb5-403b-4380-9ece-fbf5ebe0b3f6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:29.552908 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c4e4feb5-403b-4380-9ece-fbf5ebe0b3f6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:29.553356 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c4e4feb5-403b-4380-9ece-fbf5ebe0b3f6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:29.554137 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c4e4feb5-403b-4380-9ece-fbf5ebe0b3f6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:29.554570 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c4e4feb5-403b-4380-9ece-fbf5ebe0b3f6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:29.615849 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c4e4feb5-403b-4380-9ece-fbf5ebe0b3f6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:29.623319 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c4e4feb5-403b-4380-9ece-fbf5ebe0b3f6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1266 microversion: 2.1 time: 0.081312 Jul 12 17:28:29.623878 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 196/372] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:29 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:29.642492 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b416dcff-43f1-4286-a70c-9fc87fba542f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:29.643107 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b416dcff-43f1-4286-a70c-9fc87fba542f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:29.648969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b416dcff-43f1-4286-a70c-9fc87fba542f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:29.649421 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b416dcff-43f1-4286-a70c-9fc87fba542f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:29.650227 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b416dcff-43f1-4286-a70c-9fc87fba542f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:29.650665 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b416dcff-43f1-4286-a70c-9fc87fba542f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:29.777046 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b416dcff-43f1-4286-a70c-9fc87fba542f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:29.784983 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b416dcff-43f1-4286-a70c-9fc87fba542f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.146420 Jul 12 17:28:29.785999 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 177/373] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:29 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:30.326832 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d653b301-32d6-4936-be47-525ce85624d8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:30.327439 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d653b301-32d6-4936-be47-525ce85624d8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:30.333399 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d653b301-32d6-4936-be47-525ce85624d8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:30.333885 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d653b301-32d6-4936-be47-525ce85624d8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:30.334638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d653b301-32d6-4936-be47-525ce85624d8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:30.335075 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d653b301-32d6-4936-be47-525ce85624d8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:30.461075 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d653b301-32d6-4936-be47-525ce85624d8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:30.468883 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d653b301-32d6-4936-be47-525ce85624d8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:30.470476 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d653b301-32d6-4936-be47-525ce85624d8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:30.471546 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d653b301-32d6-4936-be47-525ce85624d8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.149322 Jul 12 17:28:30.472101 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 197/374] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:30 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:30.527949 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8705d788-b39f-47a1-ab3b-c7689baecc05 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:30.528620 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8705d788-b39f-47a1-ab3b-c7689baecc05 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:30.531077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:30.537090 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8705d788-b39f-47a1-ab3b-c7689baecc05 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:30.537569 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8705d788-b39f-47a1-ab3b-c7689baecc05 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:30.538408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8705d788-b39f-47a1-ab3b-c7689baecc05 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:30.538849 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8705d788-b39f-47a1-ab3b-c7689baecc05 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:30.639510 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bf5ea3b3-ad2e-44b5-8b99-6ac9b3e724aa tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:30.640099 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bf5ea3b3-ad2e-44b5-8b99-6ac9b3e724aa tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:30.645941 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bf5ea3b3-ad2e-44b5-8b99-6ac9b3e724aa tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:30.646385 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bf5ea3b3-ad2e-44b5-8b99-6ac9b3e724aa tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:30.647141 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bf5ea3b3-ad2e-44b5-8b99-6ac9b3e724aa tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:30.647573 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bf5ea3b3-ad2e-44b5-8b99-6ac9b3e724aa tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:30.670590 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8705d788-b39f-47a1-ab3b-c7689baecc05 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:30.678087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8705d788-b39f-47a1-ab3b-c7689baecc05 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.154221 Jul 12 17:28:30.678843 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 178/375] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:30 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:30.712830 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bf5ea3b3-ad2e-44b5-8b99-6ac9b3e724aa tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:30.721021 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bf5ea3b3-ad2e-44b5-8b99-6ac9b3e724aa tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1274 microversion: 2.1 time: 0.085382 Jul 12 17:28:30.721976 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 198/376] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:30 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:30.802654 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5b352e32-3176-4a2f-9fd4-db47418a5485 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:30.803344 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5b352e32-3176-4a2f-9fd4-db47418a5485 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:30.809969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5b352e32-3176-4a2f-9fd4-db47418a5485 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:30.810380 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5b352e32-3176-4a2f-9fd4-db47418a5485 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:30.811255 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5b352e32-3176-4a2f-9fd4-db47418a5485 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:30.811864 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5b352e32-3176-4a2f-9fd4-db47418a5485 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:31.024834 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5b352e32-3176-4a2f-9fd4-db47418a5485 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:31.043900 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5b352e32-3176-4a2f-9fd4-db47418a5485 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.244882 Jul 12 17:28:31.051207 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 179/377] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:30 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:31.490111 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d7359d9b-666f-4e5d-813b-d6efb3586f77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:31.490738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d7359d9b-666f-4e5d-813b-d6efb3586f77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:31.523092 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d7359d9b-666f-4e5d-813b-d6efb3586f77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:31.523535 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d7359d9b-666f-4e5d-813b-d6efb3586f77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:31.527866 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d7359d9b-666f-4e5d-813b-d6efb3586f77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:31.528315 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d7359d9b-666f-4e5d-813b-d6efb3586f77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:31.679381 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d7359d9b-666f-4e5d-813b-d6efb3586f77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:31.688139 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d7359d9b-666f-4e5d-813b-d6efb3586f77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:31.689907 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d7359d9b-666f-4e5d-813b-d6efb3586f77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:31.694627 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d7359d9b-666f-4e5d-813b-d6efb3586f77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1407 microversion: 2.20 time: 0.208741 Jul 12 17:28:31.695204 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 199/378] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:31 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:31.695896 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c78d6799-2423-4f0c-99d7-6a79c4fcd4c5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:31.697135 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c78d6799-2423-4f0c-99d7-6a79c4fcd4c5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:31.704579 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c78d6799-2423-4f0c-99d7-6a79c4fcd4c5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:31.705284 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c78d6799-2423-4f0c-99d7-6a79c4fcd4c5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:31.706337 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c78d6799-2423-4f0c-99d7-6a79c4fcd4c5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:31.706986 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c78d6799-2423-4f0c-99d7-6a79c4fcd4c5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:31.740795 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9e64ebc5-af1a-4d3b-bd06-e6ca424579fe tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:31.741651 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9e64ebc5-af1a-4d3b-bd06-e6ca424579fe tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:31.752956 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e64ebc5-af1a-4d3b-bd06-e6ca424579fe tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:31.753675 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e64ebc5-af1a-4d3b-bd06-e6ca424579fe tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:31.755483 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e64ebc5-af1a-4d3b-bd06-e6ca424579fe tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:31.758519 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e64ebc5-af1a-4d3b-bd06-e6ca424579fe tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:31.884716 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9e64ebc5-af1a-4d3b-bd06-e6ca424579fe tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:31.902214 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9e64ebc5-af1a-4d3b-bd06-e6ca424579fe tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1272 microversion: 2.1 time: 0.166098 Jul 12 17:28:31.903634 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 200/379] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:31 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:31.976187 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c78d6799-2423-4f0c-99d7-6a79c4fcd4c5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:31.990648 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c78d6799-2423-4f0c-99d7-6a79c4fcd4c5 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.298984 Jul 12 17:28:31.991357 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 180/380] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:31 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:32.061259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-db3adfd6-839d-4346-9afe-641acbe3046f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:32.062172 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-db3adfd6-839d-4346-9afe-641acbe3046f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:32.069267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db3adfd6-839d-4346-9afe-641acbe3046f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:32.069755 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db3adfd6-839d-4346-9afe-641acbe3046f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:32.070543 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db3adfd6-839d-4346-9afe-641acbe3046f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:32.071236 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db3adfd6-839d-4346-9afe-641acbe3046f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:32.223879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-db3adfd6-839d-4346-9afe-641acbe3046f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:32.236817 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-db3adfd6-839d-4346-9afe-641acbe3046f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.179863 Jul 12 17:28:32.237580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 201/381] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:32 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:32.713768 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3f121bab-60c1-490e-b1e8-5f155f0a3a04 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:32.714325 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3f121bab-60c1-490e-b1e8-5f155f0a3a04 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:32.721650 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3f121bab-60c1-490e-b1e8-5f155f0a3a04 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:32.722535 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3f121bab-60c1-490e-b1e8-5f155f0a3a04 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:32.723569 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3f121bab-60c1-490e-b1e8-5f155f0a3a04 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:32.724221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3f121bab-60c1-490e-b1e8-5f155f0a3a04 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:32.857778 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3f121bab-60c1-490e-b1e8-5f155f0a3a04 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:32.865572 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3f121bab-60c1-490e-b1e8-5f155f0a3a04 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:32.867136 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3f121bab-60c1-490e-b1e8-5f155f0a3a04 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:32.868280 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3f121bab-60c1-490e-b1e8-5f155f0a3a04 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1600 microversion: 2.20 time: 0.158423 Jul 12 17:28:32.868835 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 181/382] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:28:32 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:28:32.885987 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7ae63b4a-dec3-4a85-8aa8-1c6aa7f65554 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:32.886465 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7ae63b4a-dec3-4a85-8aa8-1c6aa7f65554 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:32.892885 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ae63b4a-dec3-4a85-8aa8-1c6aa7f65554 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:32.893325 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ae63b4a-dec3-4a85-8aa8-1c6aa7f65554 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:32.894107 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ae63b4a-dec3-4a85-8aa8-1c6aa7f65554 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:32.894535 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7ae63b4a-dec3-4a85-8aa8-1c6aa7f65554 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:32.919546 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4b4dd5a8-d160-404e-8453-fffa9469d05a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:32.920119 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4b4dd5a8-d160-404e-8453-fffa9469d05a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:32.926110 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4b4dd5a8-d160-404e-8453-fffa9469d05a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:32.926555 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4b4dd5a8-d160-404e-8453-fffa9469d05a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:32.927319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4b4dd5a8-d160-404e-8453-fffa9469d05a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:32.927753 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4b4dd5a8-d160-404e-8453-fffa9469d05a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:32.980191 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7ae63b4a-dec3-4a85-8aa8-1c6aa7f65554 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098027 Jul 12 17:28:32.980934 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 202/383] 10.222.0.62 () {60 vars in 1315 bytes} [Tue Jul 12 17:28:32 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:28:33.008166 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ee5869fb-85c9-4ff8-8383-695c65fe66c2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:33.008777 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ee5869fb-85c9-4ff8-8383-695c65fe66c2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:33.015703 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ee5869fb-85c9-4ff8-8383-695c65fe66c2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:33.016147 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ee5869fb-85c9-4ff8-8383-695c65fe66c2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:33.016902 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ee5869fb-85c9-4ff8-8383-695c65fe66c2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:33.017334 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ee5869fb-85c9-4ff8-8383-695c65fe66c2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:33.105340 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4b4dd5a8-d160-404e-8453-fffa9469d05a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:33.109388 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:33.114486 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4b4dd5a8-d160-404e-8453-fffa9469d05a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1314 microversion: 2.1 time: 0.198749 Jul 12 17:28:33.115407 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 182/384] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:32 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:33.168235 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ee5869fb-85c9-4ff8-8383-695c65fe66c2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:33.175659 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ee5869fb-85c9-4ff8-8383-695c65fe66c2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.171448 Jul 12 17:28:33.176404 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 203/385] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:33 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:33.254615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-42a8ab79-3f9b-4083-8173-8a302db8e80d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:33.255231 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-42a8ab79-3f9b-4083-8173-8a302db8e80d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:33.261655 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-42a8ab79-3f9b-4083-8173-8a302db8e80d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:33.262698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-42a8ab79-3f9b-4083-8173-8a302db8e80d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:33.263466 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-42a8ab79-3f9b-4083-8173-8a302db8e80d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:33.263905 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-42a8ab79-3f9b-4083-8173-8a302db8e80d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:33.395098 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-42a8ab79-3f9b-4083-8173-8a302db8e80d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:33.402528 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-42a8ab79-3f9b-4083-8173-8a302db8e80d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.152328 Jul 12 17:28:33.403098 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 183/386] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:33 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:34.132182 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b4f7b277-9101-4a66-b6ac-9f05eba6125d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:34.133547 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b4f7b277-9101-4a66-b6ac-9f05eba6125d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:34.140283 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b4f7b277-9101-4a66-b6ac-9f05eba6125d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:34.140734 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b4f7b277-9101-4a66-b6ac-9f05eba6125d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:34.141674 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b4f7b277-9101-4a66-b6ac-9f05eba6125d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:34.142151 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b4f7b277-9101-4a66-b6ac-9f05eba6125d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:34.197248 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-43a32dcd-5b63-4154-88b5-9511ae810425 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:34.198641 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-43a32dcd-5b63-4154-88b5-9511ae810425 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:34.206865 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-43a32dcd-5b63-4154-88b5-9511ae810425 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:34.207579 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-43a32dcd-5b63-4154-88b5-9511ae810425 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:34.209615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-43a32dcd-5b63-4154-88b5-9511ae810425 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:34.210453 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-43a32dcd-5b63-4154-88b5-9511ae810425 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:34.326154 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b4f7b277-9101-4a66-b6ac-9f05eba6125d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:34.335711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b4f7b277-9101-4a66-b6ac-9f05eba6125d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1314 microversion: 2.1 time: 0.206853 Jul 12 17:28:34.336644 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 204/387] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:34 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:34.397359 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-43a32dcd-5b63-4154-88b5-9511ae810425 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:34.410947 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-43a32dcd-5b63-4154-88b5-9511ae810425 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.222380 Jul 12 17:28:34.411952 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 184/388] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:34 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:34.419478 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d7b2f8a3-d3d1-40dc-95ee-ae9efa405f9f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:34.420320 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d7b2f8a3-d3d1-40dc-95ee-ae9efa405f9f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:34.426998 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d7b2f8a3-d3d1-40dc-95ee-ae9efa405f9f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:34.427659 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d7b2f8a3-d3d1-40dc-95ee-ae9efa405f9f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:34.428551 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d7b2f8a3-d3d1-40dc-95ee-ae9efa405f9f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:34.429186 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d7b2f8a3-d3d1-40dc-95ee-ae9efa405f9f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:34.570098 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d7b2f8a3-d3d1-40dc-95ee-ae9efa405f9f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:34.578371 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d7b2f8a3-d3d1-40dc-95ee-ae9efa405f9f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.162757 Jul 12 17:28:34.578954 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 205/389] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:34 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:34.793350 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-9288c91d-b4c1-48ad-8df8-e85021e4f6b5 req-9aab7a60-6195-46d4-8e84-4ca81de7542b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48b5e50f-5079-438b-ac33-67623b4428f5", "tag": "e0dd8828-dbc7-4d01-9d3f-ee997fb3d5ce"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:28:34.801501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-9288c91d-b4c1-48ad-8df8-e85021e4f6b5 req-9aab7a60-6195-46d4-8e84-4ca81de7542b service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:34.802232 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-9288c91d-b4c1-48ad-8df8-e85021e4f6b5 req-9aab7a60-6195-46d4-8e84-4ca81de7542b service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:34.814449 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-9288c91d-b4c1-48ad-8df8-e85021e4f6b5 req-9aab7a60-6195-46d4-8e84-4ca81de7542b service nova] Creating event network-changed:e0dd8828-dbc7-4d01-9d3f-ee997fb3d5ce for instance 48b5e50f-5079-438b-ac33-67623b4428f5 on hv-cinder-84932 Jul 12 17:28:34.820007 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-9288c91d-b4c1-48ad-8df8-e85021e4f6b5 req-9aab7a60-6195-46d4-8e84-4ca81de7542b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030375 Jul 12 17:28:34.821372 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 185/390] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:28:35.352549 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-97deaa67-6d27-43b7-9e90-ebadc82003a5 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:35.353114 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-97deaa67-6d27-43b7-9e90-ebadc82003a5 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:35.359750 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-97deaa67-6d27-43b7-9e90-ebadc82003a5 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:35.360190 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-97deaa67-6d27-43b7-9e90-ebadc82003a5 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:35.360946 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-97deaa67-6d27-43b7-9e90-ebadc82003a5 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:35.361417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-97deaa67-6d27-43b7-9e90-ebadc82003a5 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:35.430185 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1a70536e-4e63-42fa-8d59-03345aac534f tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:35.431781 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1a70536e-4e63-42fa-8d59-03345aac534f tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:35.441417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1a70536e-4e63-42fa-8d59-03345aac534f tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:35.441918 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1a70536e-4e63-42fa-8d59-03345aac534f tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:35.442751 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1a70536e-4e63-42fa-8d59-03345aac534f tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:35.443216 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1a70536e-4e63-42fa-8d59-03345aac534f tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:35.521364 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-97deaa67-6d27-43b7-9e90-ebadc82003a5 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:35.526570 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:35.532555 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-97deaa67-6d27-43b7-9e90-ebadc82003a5 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1314 microversion: 2.1 time: 0.183871 Jul 12 17:28:35.533176 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 206/391] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:35 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:35.596089 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-22cb1e90-bf31-4172-a1e3-8825ab1ee6b3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:35.596865 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-22cb1e90-bf31-4172-a1e3-8825ab1ee6b3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:35.603861 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-22cb1e90-bf31-4172-a1e3-8825ab1ee6b3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:35.604314 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-22cb1e90-bf31-4172-a1e3-8825ab1ee6b3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:35.605086 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-22cb1e90-bf31-4172-a1e3-8825ab1ee6b3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:35.606685 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-22cb1e90-bf31-4172-a1e3-8825ab1ee6b3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:35.636146 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1a70536e-4e63-42fa-8d59-03345aac534f tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:35.647244 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1a70536e-4e63-42fa-8d59-03345aac534f tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.222500 Jul 12 17:28:35.649775 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 186/392] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:35 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:35.769252 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-22cb1e90-bf31-4172-a1e3-8825ab1ee6b3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:35.780192 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-22cb1e90-bf31-4172-a1e3-8825ab1ee6b3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.188261 Jul 12 17:28:35.780774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 207/393] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:35 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:36.548812 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0dca71a7-99d7-4ba7-8379-a4bff4f66218 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:36.550191 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0dca71a7-99d7-4ba7-8379-a4bff4f66218 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:36.556783 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0dca71a7-99d7-4ba7-8379-a4bff4f66218 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:36.557469 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0dca71a7-99d7-4ba7-8379-a4bff4f66218 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:36.558495 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0dca71a7-99d7-4ba7-8379-a4bff4f66218 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:36.559597 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0dca71a7-99d7-4ba7-8379-a4bff4f66218 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:36.668511 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6b4a04f3-1832-435a-b765-e8417b586f36 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:36.673858 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6b4a04f3-1832-435a-b765-e8417b586f36 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:36.689296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b4a04f3-1832-435a-b765-e8417b586f36 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:36.690381 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b4a04f3-1832-435a-b765-e8417b586f36 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:36.692963 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b4a04f3-1832-435a-b765-e8417b586f36 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:36.694772 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b4a04f3-1832-435a-b765-e8417b586f36 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:36.779803 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0dca71a7-99d7-4ba7-8379-a4bff4f66218 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:36.789002 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0dca71a7-99d7-4ba7-8379-a4bff4f66218 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1314 microversion: 2.1 time: 0.243939 Jul 12 17:28:36.802275 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 187/394] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:36 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:36.824379 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8102c915-f18b-44d7-8df8-9dad4cbefbec tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:36.824997 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8102c915-f18b-44d7-8df8-9dad4cbefbec tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:36.846147 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8102c915-f18b-44d7-8df8-9dad4cbefbec tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:36.846712 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8102c915-f18b-44d7-8df8-9dad4cbefbec tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:36.847564 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8102c915-f18b-44d7-8df8-9dad4cbefbec tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:36.848007 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8102c915-f18b-44d7-8df8-9dad4cbefbec tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:36.957020 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6b4a04f3-1832-435a-b765-e8417b586f36 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:36.966730 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6b4a04f3-1832-435a-b765-e8417b586f36 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.303876 Jul 12 17:28:36.967336 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 208/395] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:36 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:36.977861 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-a979de81-046f-4308-afd2-9742d6d37ac4 req-09a134de-0be8-4dd6-ae1f-cdb0d871a71f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eff76d7-a7a3-4145-a17b-83a9e40840cb", "tag": "b1173d06-ed5d-4496-b1f5-30ad400ccca1"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:28:36.986492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-a979de81-046f-4308-afd2-9742d6d37ac4 req-09a134de-0be8-4dd6-ae1f-cdb0d871a71f service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:36.986926 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-a979de81-046f-4308-afd2-9742d6d37ac4 req-09a134de-0be8-4dd6-ae1f-cdb0d871a71f service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:36.999362 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-a979de81-046f-4308-afd2-9742d6d37ac4 req-09a134de-0be8-4dd6-ae1f-cdb0d871a71f service nova] Creating event network-changed:b1173d06-ed5d-4496-b1f5-30ad400ccca1 for instance 1eff76d7-a7a3-4145-a17b-83a9e40840cb on hv-cinder-84932 Jul 12 17:28:37.004776 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-a979de81-046f-4308-afd2-9742d6d37ac4 req-09a134de-0be8-4dd6-ae1f-cdb0d871a71f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035547 Jul 12 17:28:37.005616 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 209/396] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:28:37.032566 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8102c915-f18b-44d7-8df8-9dad4cbefbec tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:37.040204 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8102c915-f18b-44d7-8df8-9dad4cbefbec tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.236629 Jul 12 17:28:37.040774 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 188/397] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:36 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:37.807827 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f72f0966-b576-449c-9d12-8cdd14c6ed23 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:37.808566 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f72f0966-b576-449c-9d12-8cdd14c6ed23 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:37.814829 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f72f0966-b576-449c-9d12-8cdd14c6ed23 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:37.815293 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f72f0966-b576-449c-9d12-8cdd14c6ed23 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:37.816036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f72f0966-b576-449c-9d12-8cdd14c6ed23 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:37.816469 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f72f0966-b576-449c-9d12-8cdd14c6ed23 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:37.986193 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1c4eaa4b-873c-49dd-95c0-608674d73c23 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:37.987388 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1c4eaa4b-873c-49dd-95c0-608674d73c23 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:37.998001 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c4eaa4b-873c-49dd-95c0-608674d73c23 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:37.998831 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c4eaa4b-873c-49dd-95c0-608674d73c23 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:37.999804 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c4eaa4b-873c-49dd-95c0-608674d73c23 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:38.003455 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c4eaa4b-873c-49dd-95c0-608674d73c23 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:38.071024 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f72f0966-b576-449c-9d12-8cdd14c6ed23 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:38.080151 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f72f0966-b576-449c-9d12-8cdd14c6ed23 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1314 microversion: 2.1 time: 0.276666 Jul 12 17:28:38.080723 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 210/398] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:37 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:38.085516 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-28c2495a-241d-430b-9bbf-4127aef6771e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:38.086281 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-28c2495a-241d-430b-9bbf-4127aef6771e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:38.092629 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-28c2495a-241d-430b-9bbf-4127aef6771e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:38.093074 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-28c2495a-241d-430b-9bbf-4127aef6771e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:38.093870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-28c2495a-241d-430b-9bbf-4127aef6771e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:38.094300 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-28c2495a-241d-430b-9bbf-4127aef6771e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:38.328646 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1c4eaa4b-873c-49dd-95c0-608674d73c23 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:38.336401 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1c4eaa4b-873c-49dd-95c0-608674d73c23 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.354285 Jul 12 17:28:38.337097 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 189/399] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:37 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:38.351483 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-28c2495a-241d-430b-9bbf-4127aef6771e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:38.359803 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-28c2495a-241d-430b-9bbf-4127aef6771e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1501 microversion: 2.1 time: 0.278146 Jul 12 17:28:38.360358 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 211/400] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:38 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1501 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:38.376802 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-512e8955-f19e-45b8-a26f-87bede827c7d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89924db3-2c7e-43d8-bb91-a6a49fdea7cf"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:28:38.377959 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-512e8955-f19e-45b8-a26f-87bede827c7d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:38.383931 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-512e8955-f19e-45b8-a26f-87bede827c7d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:38.384379 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-512e8955-f19e-45b8-a26f-87bede827c7d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:38.385144 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-512e8955-f19e-45b8-a26f-87bede827c7d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:38.385576 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-512e8955-f19e-45b8-a26f-87bede827c7d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:38.408688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-512e8955-f19e-45b8-a26f-87bede827c7d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] HTTP exception thrown: Cannot 'attach_volume' instance f4d99e1a-efd3-4510-ac75-1c21c7937044 while it is in vm_state rescued Jul 12 17:28:38.410408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-512e8955-f19e-45b8-a26f-87bede827c7d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Request method failure captured: Jul 12 17:28:38.410408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: POST /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044/os-volume_attachments HTTP/1.1 Jul 12 17:28:38.410408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:28:38.410408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:28:38.410408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:28:38.410408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 74 Jul 12 17:28:38.410408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:28:38.410408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:28:38.410408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:28:38.410408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:28:38.410408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza6rtSgQfpSEtZ33IwhEqpKxmMGz09pu5YbdTNTT6Fheask6iWh4UHUt4FI8V1LgyIrpYykgBodOOWWf2Mu8K7Zj7tYnj7ZacrJDVDubl2Llq3NDzasM5K4t3A3ipyRv-AeEDGWJXxr1RuzCzLapbei7evPQzraouwzSNqwP_LaByJ8 Jul 12 17:28:38.410408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:28:38.410408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:28:38.410408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:28:38.410408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:28:38.410408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:28:38.410408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:28:38.410408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: 13884af024db42bcb013e475df0a53f0 Jul 12 17:28:38.410408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-425710136 Jul 12 17:28:38.410408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:28:38.410408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:28:38.411918 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/13884af024db42bcb013e475df0a53f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/13884af024db42bcb013e475df0a53f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/13884af024db42bcb013e475df0a53f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_13884af024db42bcb013e475df0a53f0", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:28:38.411918 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-ServerRescueNegativeTestJSON-425710136 Jul 12 17:28:38.411918 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 13884af024db42bcb013e475df0a53f0 Jul 12 17:28:38.411918 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-425710136 Jul 12 17:28:38.411918 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-ServerRescueNegativeTestJSON-425710136-project Jul 12 17:28:38.411918 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:28:38.411918 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:28:38.411918 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: 35e0364ccc1d4992932e8483e3f1f9d6 Jul 12 17:28:38.411918 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-ServerRescueNegativeTestJSON-425710136-project Jul 12 17:28:38.411918 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Jul 12 17:28:38.411918 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {"volumeAttachment": {"volumeId": "89924db3-2c7e-43d8-bb91-a6a49fdea7cf"}} Jul 12 17:28:38.411918 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:28:38.412836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Cannot 'attach_volume' instance f4d99e1a-efd3-4510-ac75-1c21c7937044 while it is in vm_state rescued Jul 12 17:28:38.412836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'server_id': 'f4d99e1a-efd3-4510-ac75-1c21c7937044', 'body': {'volumeAttachment': {'volumeId': '89924db3-2c7e-43d8-bb91-a6a49fdea7cf'}}} Jul 12 17:28:38.412836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:28:38.412836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:28:38.412836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 17:28:38.412836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 17:28:38.412836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 17:28:38.412836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 17:28:38.412836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 17:28:38.412836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 17:28:38.412836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4d99e1a-efd3-4510-ac75-1c21c7937044 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 12 17:28:38.412836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:28:38.412836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:28:38.412836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:28:38.412836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:28:38.412836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:28:38.412836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:28:38.412836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:28:38.412836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:28:38.414289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:28:38.414289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:28:38.414289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 17:28:38.414289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:28:38.414289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 17:28:38.414289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:28:38.414289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 17:28:38.414289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:28:38.414289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 12 17:28:38.414289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 17:28:38.414289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 17:28:38.414289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 17:28:38.414289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f4d99e1a-efd3-4510-ac75-1c21c7937044 while it is in vm_state rescued Jul 12 17:28:38.414289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:28:38.414289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:28:38.414289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:28:38.414289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:28:38.414289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:28:38.414289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:28:38.415656 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:28:38.415656 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:28:38.415656 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f4d99e1a-efd3-4510-ac75-1c21c7937044 while it is in vm_state rescued Jul 12 17:28:38.415656 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:28:38.415656 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-512e8955-f19e-45b8-a26f-87bede827c7d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Returning 409 to user: Cannot 'attach_volume' instance f4d99e1a-efd3-4510-ac75-1c21c7937044 while it is in vm_state rescued {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:28:38.415656 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-512e8955-f19e-45b8-a26f-87bede827c7d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "POST /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038959 Jul 12 17:28:38.415656 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 190/401] 10.222.0.62 () {60 vars in 1322 bytes} [Tue Jul 12 17:28:38 2022] POST /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 17:28:38.420926 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-84ddfc04-af28-438a-90a9-4283f5929d77 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:28:38.421496 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-84ddfc04-af28-438a-90a9-4283f5929d77 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:38.427441 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-84ddfc04-af28-438a-90a9-4283f5929d77 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:38.427887 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-84ddfc04-af28-438a-90a9-4283f5929d77 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:38.428648 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-84ddfc04-af28-438a-90a9-4283f5929d77 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:38.429084 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-84ddfc04-af28-438a-90a9-4283f5929d77 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:38.492928 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-84ddfc04-af28-438a-90a9-4283f5929d77 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "POST /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044/action" status: 202 len: 0 microversion: 2.1 time: 0.075610 Jul 12 17:28:38.493607 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 212/402] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Jul 12 17:28:38 2022] POST /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 17:28:38.503053 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d5bbedb7-bff0-4ed6-8089-9dfb6039a8b8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:38.503683 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d5bbedb7-bff0-4ed6-8089-9dfb6039a8b8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:38.509645 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d5bbedb7-bff0-4ed6-8089-9dfb6039a8b8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:38.510125 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d5bbedb7-bff0-4ed6-8089-9dfb6039a8b8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:38.510913 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d5bbedb7-bff0-4ed6-8089-9dfb6039a8b8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:38.511376 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d5bbedb7-bff0-4ed6-8089-9dfb6039a8b8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:38.643029 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d5bbedb7-bff0-4ed6-8089-9dfb6039a8b8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:38.650745 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d5bbedb7-bff0-4ed6-8089-9dfb6039a8b8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1509 microversion: 2.1 time: 0.152322 Jul 12 17:28:38.651355 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 191/403] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:38 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:39.097305 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-69b70071-d5da-4b82-be37-b797a468ad5c tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:39.098038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-69b70071-d5da-4b82-be37-b797a468ad5c tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:39.104231 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-69b70071-d5da-4b82-be37-b797a468ad5c tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:39.104681 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-69b70071-d5da-4b82-be37-b797a468ad5c tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:39.106079 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-69b70071-d5da-4b82-be37-b797a468ad5c tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:39.106523 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-69b70071-d5da-4b82-be37-b797a468ad5c tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:39.234432 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-69b70071-d5da-4b82-be37-b797a468ad5c tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:39.241799 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-69b70071-d5da-4b82-be37-b797a468ad5c tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1314 microversion: 2.1 time: 0.148717 Jul 12 17:28:39.242366 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 213/404] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:39 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:39.352702 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-99e977b8-2f21-4b5b-a3e8-febcaaa2bc8a tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:39.353313 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-99e977b8-2f21-4b5b-a3e8-febcaaa2bc8a tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:39.360663 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-99e977b8-2f21-4b5b-a3e8-febcaaa2bc8a tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:39.361109 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-99e977b8-2f21-4b5b-a3e8-febcaaa2bc8a tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:39.361902 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-99e977b8-2f21-4b5b-a3e8-febcaaa2bc8a tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:39.362332 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-99e977b8-2f21-4b5b-a3e8-febcaaa2bc8a tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:39.408806 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-95f46812-70f6-4312-ba16-cef746fbf257 req-d7d763d3-6de8-4892-8adb-234724d84c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad9cb42e-ab4c-4156-8944-5c8ddd677b0f", "name": "network-vif-plugged", "status": "completed", "tag": "e5729bfd-6f0d-43dc-88e8-b8b9b0480a96"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:28:39.418010 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-95f46812-70f6-4312-ba16-cef746fbf257 req-d7d763d3-6de8-4892-8adb-234724d84c21 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:39.418458 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-95f46812-70f6-4312-ba16-cef746fbf257 req-d7d763d3-6de8-4892-8adb-234724d84c21 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:39.434000 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-95f46812-70f6-4312-ba16-cef746fbf257 req-d7d763d3-6de8-4892-8adb-234724d84c21 service nova] Creating event network-vif-plugged:e5729bfd-6f0d-43dc-88e8-b8b9b0480a96 for instance ad9cb42e-ab4c-4156-8944-5c8ddd677b0f on hv-cinder-84932 Jul 12 17:28:39.439482 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-95f46812-70f6-4312-ba16-cef746fbf257 req-d7d763d3-6de8-4892-8adb-234724d84c21 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035633 Jul 12 17:28:39.440382 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 214/405] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:28:39.507483 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-99e977b8-2f21-4b5b-a3e8-febcaaa2bc8a tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:39.516047 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-99e977b8-2f21-4b5b-a3e8-febcaaa2bc8a tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.167390 Jul 12 17:28:39.516612 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 192/406] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:39 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:39.668552 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c913f515-3849-4c54-b8a7-fae657d6cfee tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:39.669245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c913f515-3849-4c54-b8a7-fae657d6cfee tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:39.676549 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c913f515-3849-4c54-b8a7-fae657d6cfee tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:39.677058 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c913f515-3849-4c54-b8a7-fae657d6cfee tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:39.677759 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c913f515-3849-4c54-b8a7-fae657d6cfee tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:39.678188 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c913f515-3849-4c54-b8a7-fae657d6cfee tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:39.806937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c913f515-3849-4c54-b8a7-fae657d6cfee tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:39.814934 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c913f515-3849-4c54-b8a7-fae657d6cfee tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1509 microversion: 2.1 time: 0.150760 Jul 12 17:28:39.815491 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 215/407] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:39 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:40.257541 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-974924c0-4d75-4f05-ae8d-0741dd38e74c tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:40.258262 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-974924c0-4d75-4f05-ae8d-0741dd38e74c tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:40.264198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-974924c0-4d75-4f05-ae8d-0741dd38e74c tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:40.264649 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-974924c0-4d75-4f05-ae8d-0741dd38e74c tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:40.265406 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-974924c0-4d75-4f05-ae8d-0741dd38e74c tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:40.265885 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-974924c0-4d75-4f05-ae8d-0741dd38e74c tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:40.392410 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-974924c0-4d75-4f05-ae8d-0741dd38e74c tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:40.399634 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-974924c0-4d75-4f05-ae8d-0741dd38e74c tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1314 microversion: 2.1 time: 0.145948 Jul 12 17:28:40.400288 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 193/408] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:40 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:40.532729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-72833335-b4b4-48e9-8bea-ac94804d71ca tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:40.533263 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-72833335-b4b4-48e9-8bea-ac94804d71ca tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:40.539160 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-72833335-b4b4-48e9-8bea-ac94804d71ca tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:40.539599 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-72833335-b4b4-48e9-8bea-ac94804d71ca tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:40.540346 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-72833335-b4b4-48e9-8bea-ac94804d71ca tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:40.540771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-72833335-b4b4-48e9-8bea-ac94804d71ca tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:40.673919 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-72833335-b4b4-48e9-8bea-ac94804d71ca tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:40.683228 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-72833335-b4b4-48e9-8bea-ac94804d71ca tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.152946 Jul 12 17:28:40.683691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 216/409] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:40 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:40.833131 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-40c3ce0e-4420-4719-a292-9ec35953ee30 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:40.833794 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-40c3ce0e-4420-4719-a292-9ec35953ee30 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:40.841960 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-40c3ce0e-4420-4719-a292-9ec35953ee30 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:40.842400 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-40c3ce0e-4420-4719-a292-9ec35953ee30 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:40.843176 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-40c3ce0e-4420-4719-a292-9ec35953ee30 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:40.843775 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-40c3ce0e-4420-4719-a292-9ec35953ee30 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:40.971105 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-40c3ce0e-4420-4719-a292-9ec35953ee30 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:40.978383 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-40c3ce0e-4420-4719-a292-9ec35953ee30 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1509 microversion: 2.1 time: 0.149222 Jul 12 17:28:40.978938 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 194/410] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:40 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:41.416393 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0eee6e20-cf54-4382-a51b-acdc394a6374 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:41.416995 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0eee6e20-cf54-4382-a51b-acdc394a6374 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:41.423029 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0eee6e20-cf54-4382-a51b-acdc394a6374 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:41.423465 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0eee6e20-cf54-4382-a51b-acdc394a6374 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:41.424208 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0eee6e20-cf54-4382-a51b-acdc394a6374 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:41.424633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0eee6e20-cf54-4382-a51b-acdc394a6374 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:41.553658 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0eee6e20-cf54-4382-a51b-acdc394a6374 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:41.561455 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0eee6e20-cf54-4382-a51b-acdc394a6374 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1314 microversion: 2.1 time: 0.148900 Jul 12 17:28:41.562199 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 217/411] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:41 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:41.700319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-308eee78-80f6-42e3-8ea2-361d082218f2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:41.700933 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-308eee78-80f6-42e3-8ea2-361d082218f2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:41.707421 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-308eee78-80f6-42e3-8ea2-361d082218f2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:41.707872 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-308eee78-80f6-42e3-8ea2-361d082218f2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:41.708634 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-308eee78-80f6-42e3-8ea2-361d082218f2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:41.709071 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-308eee78-80f6-42e3-8ea2-361d082218f2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:41.837097 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-308eee78-80f6-42e3-8ea2-361d082218f2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:41.844374 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-308eee78-80f6-42e3-8ea2-361d082218f2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.147885 Jul 12 17:28:41.844935 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 195/412] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:41 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:41.995569 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-60c4fd1a-a675-45aa-b1f6-1186eab4749a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:41.996186 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-60c4fd1a-a675-45aa-b1f6-1186eab4749a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:42.002180 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-60c4fd1a-a675-45aa-b1f6-1186eab4749a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:42.002658 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-60c4fd1a-a675-45aa-b1f6-1186eab4749a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:42.003420 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-60c4fd1a-a675-45aa-b1f6-1186eab4749a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:42.003857 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-60c4fd1a-a675-45aa-b1f6-1186eab4749a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:42.136781 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-60c4fd1a-a675-45aa-b1f6-1186eab4749a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:42.144271 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-60c4fd1a-a675-45aa-b1f6-1186eab4749a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1509 microversion: 2.1 time: 0.152531 Jul 12 17:28:42.144842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 218/413] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:41 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:42.578770 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-47c75df8-3205-496d-b2db-3ec771fdbdfd tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:42.579378 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-47c75df8-3205-496d-b2db-3ec771fdbdfd tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:42.586755 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-47c75df8-3205-496d-b2db-3ec771fdbdfd tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:42.587195 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-47c75df8-3205-496d-b2db-3ec771fdbdfd tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:42.587946 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-47c75df8-3205-496d-b2db-3ec771fdbdfd tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:42.588376 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-47c75df8-3205-496d-b2db-3ec771fdbdfd tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:42.717410 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-47c75df8-3205-496d-b2db-3ec771fdbdfd tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:42.724778 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-47c75df8-3205-496d-b2db-3ec771fdbdfd tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1314 microversion: 2.1 time: 0.149806 Jul 12 17:28:42.725334 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 196/414] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:42 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:42.860157 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6b6a10a4-5e77-4c31-9411-9f8bc3d99600 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:42.860767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6b6a10a4-5e77-4c31-9411-9f8bc3d99600 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:42.866724 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b6a10a4-5e77-4c31-9411-9f8bc3d99600 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:42.867170 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b6a10a4-5e77-4c31-9411-9f8bc3d99600 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:42.867919 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b6a10a4-5e77-4c31-9411-9f8bc3d99600 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:42.868351 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b6a10a4-5e77-4c31-9411-9f8bc3d99600 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:42.992189 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6b6a10a4-5e77-4c31-9411-9f8bc3d99600 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:43.000239 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6b6a10a4-5e77-4c31-9411-9f8bc3d99600 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.143943 Jul 12 17:28:43.000796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 219/415] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:42 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:43.161243 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-77a2400e-5200-444f-870d-4119c38ee919 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:43.161882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-77a2400e-5200-444f-870d-4119c38ee919 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:43.168580 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-77a2400e-5200-444f-870d-4119c38ee919 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:43.169021 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-77a2400e-5200-444f-870d-4119c38ee919 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:43.169828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-77a2400e-5200-444f-870d-4119c38ee919 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:43.170263 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-77a2400e-5200-444f-870d-4119c38ee919 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:43.298995 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-77a2400e-5200-444f-870d-4119c38ee919 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:43.306437 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-77a2400e-5200-444f-870d-4119c38ee919 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1509 microversion: 2.1 time: 0.149032 Jul 12 17:28:43.306994 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 197/416] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:43 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:43.741388 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-13dc12b6-b4fc-4ec8-bcbe-f6a2c45c9731 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:43.742031 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-13dc12b6-b4fc-4ec8-bcbe-f6a2c45c9731 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:43.748368 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13dc12b6-b4fc-4ec8-bcbe-f6a2c45c9731 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:43.748812 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13dc12b6-b4fc-4ec8-bcbe-f6a2c45c9731 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:43.749559 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13dc12b6-b4fc-4ec8-bcbe-f6a2c45c9731 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:43.750014 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13dc12b6-b4fc-4ec8-bcbe-f6a2c45c9731 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:43.878961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-13dc12b6-b4fc-4ec8-bcbe-f6a2c45c9731 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:43.886274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-13dc12b6-b4fc-4ec8-bcbe-f6a2c45c9731 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1314 microversion: 2.1 time: 0.148700 Jul 12 17:28:43.886845 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 220/417] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:43 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:44.016296 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-66dda69e-2c4a-4d6a-930f-33cfed657226 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:44.016822 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-66dda69e-2c4a-4d6a-930f-33cfed657226 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:44.023190 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-66dda69e-2c4a-4d6a-930f-33cfed657226 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:44.023635 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-66dda69e-2c4a-4d6a-930f-33cfed657226 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:44.024386 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-66dda69e-2c4a-4d6a-930f-33cfed657226 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:44.024813 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-66dda69e-2c4a-4d6a-930f-33cfed657226 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:44.220032 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-66dda69e-2c4a-4d6a-930f-33cfed657226 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:44.227576 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-66dda69e-2c4a-4d6a-930f-33cfed657226 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.215183 Jul 12 17:28:44.228151 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 198/418] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:44 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:44.324231 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3e14f7c6-506a-43f0-96e7-a1b8b71f482a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:44.324843 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3e14f7c6-506a-43f0-96e7-a1b8b71f482a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:44.331262 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3e14f7c6-506a-43f0-96e7-a1b8b71f482a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:44.331705 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3e14f7c6-506a-43f0-96e7-a1b8b71f482a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:44.332477 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3e14f7c6-506a-43f0-96e7-a1b8b71f482a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:44.332913 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3e14f7c6-506a-43f0-96e7-a1b8b71f482a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:44.463751 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3e14f7c6-506a-43f0-96e7-a1b8b71f482a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:44.471508 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3e14f7c6-506a-43f0-96e7-a1b8b71f482a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1509 microversion: 2.1 time: 0.151468 Jul 12 17:28:44.472067 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 221/419] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:44 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:44.904035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f0d18e49-b03e-4f7e-8bc2-499ed8b560ef tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:44.904639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f0d18e49-b03e-4f7e-8bc2-499ed8b560ef tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:44.910670 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f0d18e49-b03e-4f7e-8bc2-499ed8b560ef tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:44.911112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f0d18e49-b03e-4f7e-8bc2-499ed8b560ef tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:44.911863 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f0d18e49-b03e-4f7e-8bc2-499ed8b560ef tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:44.912289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f0d18e49-b03e-4f7e-8bc2-499ed8b560ef tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:45.049397 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f0d18e49-b03e-4f7e-8bc2-499ed8b560ef tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:45.057227 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f0d18e49-b03e-4f7e-8bc2-499ed8b560ef tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1314 microversion: 2.1 time: 0.157669 Jul 12 17:28:45.058030 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 199/420] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:44 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:45.244265 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4dff62f9-4f8e-4493-94b3-c16e30ace7aa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:45.247716 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4dff62f9-4f8e-4493-94b3-c16e30ace7aa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:45.253797 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4dff62f9-4f8e-4493-94b3-c16e30ace7aa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:45.254315 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4dff62f9-4f8e-4493-94b3-c16e30ace7aa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:45.255153 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4dff62f9-4f8e-4493-94b3-c16e30ace7aa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:45.255682 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4dff62f9-4f8e-4493-94b3-c16e30ace7aa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:45.488439 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ee7cfc63-b72b-41b4-bd1b-55f4b786d6e9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:45.489071 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ee7cfc63-b72b-41b4-bd1b-55f4b786d6e9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:45.495263 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ee7cfc63-b72b-41b4-bd1b-55f4b786d6e9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:45.495789 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ee7cfc63-b72b-41b4-bd1b-55f4b786d6e9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:45.497141 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ee7cfc63-b72b-41b4-bd1b-55f4b786d6e9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:45.497576 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ee7cfc63-b72b-41b4-bd1b-55f4b786d6e9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:45.515656 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:45.556904 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4dff62f9-4f8e-4493-94b3-c16e30ace7aa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:45.566060 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4dff62f9-4f8e-4493-94b3-c16e30ace7aa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.325394 Jul 12 17:28:45.566789 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 222/421] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:45 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:45.645715 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ee7cfc63-b72b-41b4-bd1b-55f4b786d6e9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:45.653101 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ee7cfc63-b72b-41b4-bd1b-55f4b786d6e9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1509 microversion: 2.1 time: 0.168580 Jul 12 17:28:45.653651 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 200/422] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:45 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:46.074356 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-aff10625-6d6a-46e0-89e9-75675d267a88 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:46.075258 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-aff10625-6d6a-46e0-89e9-75675d267a88 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:46.081672 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aff10625-6d6a-46e0-89e9-75675d267a88 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:46.082132 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aff10625-6d6a-46e0-89e9-75675d267a88 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:46.083394 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aff10625-6d6a-46e0-89e9-75675d267a88 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:46.085057 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aff10625-6d6a-46e0-89e9-75675d267a88 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:46.228622 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-47175e22-ba81-46c3-a963-d21276c9a87f req-9eb00aed-3390-45d7-b404-b938114fd681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eff76d7-a7a3-4145-a17b-83a9e40840cb", "name": "network-vif-plugged", "status": "completed", "tag": "b1173d06-ed5d-4496-b1f5-30ad400ccca1"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:28:46.230039 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-aff10625-6d6a-46e0-89e9-75675d267a88 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:46.233907 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:46.238930 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-aff10625-6d6a-46e0-89e9-75675d267a88 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1314 microversion: 2.1 time: 0.168580 Jul 12 17:28:46.239472 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 223/423] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:46 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:46.241014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-47175e22-ba81-46c3-a963-d21276c9a87f req-9eb00aed-3390-45d7-b404-b938114fd681 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:46.241626 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-47175e22-ba81-46c3-a963-d21276c9a87f req-9eb00aed-3390-45d7-b404-b938114fd681 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:46.254708 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-47175e22-ba81-46c3-a963-d21276c9a87f req-9eb00aed-3390-45d7-b404-b938114fd681 service nova] Creating event network-vif-plugged:b1173d06-ed5d-4496-b1f5-30ad400ccca1 for instance 1eff76d7-a7a3-4145-a17b-83a9e40840cb on hv-cinder-84932 Jul 12 17:28:46.259589 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-47175e22-ba81-46c3-a963-d21276c9a87f req-9eb00aed-3390-45d7-b404-b938114fd681 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034701 Jul 12 17:28:46.260208 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 201/424] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:28:46.582787 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-edf9a9a2-b847-469e-a079-42889dfb0bdd tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:46.583415 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-edf9a9a2-b847-469e-a079-42889dfb0bdd tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:46.591073 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-edf9a9a2-b847-469e-a079-42889dfb0bdd tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:46.591749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-edf9a9a2-b847-469e-a079-42889dfb0bdd tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:46.592690 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-edf9a9a2-b847-469e-a079-42889dfb0bdd tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:46.593126 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-edf9a9a2-b847-469e-a079-42889dfb0bdd tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:46.671287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-50c4c510-e1e1-4290-a2a6-e7b25ea199b1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:46.672102 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-50c4c510-e1e1-4290-a2a6-e7b25ea199b1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:46.678640 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-50c4c510-e1e1-4290-a2a6-e7b25ea199b1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:46.679162 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-50c4c510-e1e1-4290-a2a6-e7b25ea199b1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:46.680012 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-50c4c510-e1e1-4290-a2a6-e7b25ea199b1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:46.680530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-50c4c510-e1e1-4290-a2a6-e7b25ea199b1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:47.184022 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-edf9a9a2-b847-469e-a079-42889dfb0bdd tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:47.191410 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-edf9a9a2-b847-469e-a079-42889dfb0bdd tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1358 microversion: 2.1 time: 0.612936 Jul 12 17:28:47.191975 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 224/425] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:46 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1358 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:47.207646 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-50c4c510-e1e1-4290-a2a6-e7b25ea199b1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:47.216589 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-50c4c510-e1e1-4290-a2a6-e7b25ea199b1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1509 microversion: 2.1 time: 0.550132 Jul 12 17:28:47.217155 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 202/426] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:46 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1509 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:47.255533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c5eed2dd-4cb6-4fba-b5e0-7f1328f45412 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:47.256144 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c5eed2dd-4cb6-4fba-b5e0-7f1328f45412 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:47.262631 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c5eed2dd-4cb6-4fba-b5e0-7f1328f45412 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:47.263097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c5eed2dd-4cb6-4fba-b5e0-7f1328f45412 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:47.263853 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c5eed2dd-4cb6-4fba-b5e0-7f1328f45412 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:47.264284 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c5eed2dd-4cb6-4fba-b5e0-7f1328f45412 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:47.435157 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c5eed2dd-4cb6-4fba-b5e0-7f1328f45412 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:47.442865 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c5eed2dd-4cb6-4fba-b5e0-7f1328f45412 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1314 microversion: 2.1 time: 0.191258 Jul 12 17:28:47.444095 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 225/427] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:47 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:48.208321 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-65829af4-4f85-4f41-9e83-5e540d6b19cd tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:48.208933 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-65829af4-4f85-4f41-9e83-5e540d6b19cd tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:48.215880 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-65829af4-4f85-4f41-9e83-5e540d6b19cd tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:48.216325 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-65829af4-4f85-4f41-9e83-5e540d6b19cd tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:48.217178 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-65829af4-4f85-4f41-9e83-5e540d6b19cd tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:48.217621 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-65829af4-4f85-4f41-9e83-5e540d6b19cd tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:48.234271 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7efba6a7-2847-4cc6-b5d8-1a86872275b2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:48.235495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7efba6a7-2847-4cc6-b5d8-1a86872275b2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:48.241578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7efba6a7-2847-4cc6-b5d8-1a86872275b2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:48.242276 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7efba6a7-2847-4cc6-b5d8-1a86872275b2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:48.243224 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7efba6a7-2847-4cc6-b5d8-1a86872275b2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:48.243660 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7efba6a7-2847-4cc6-b5d8-1a86872275b2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:48.415207 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-65829af4-4f85-4f41-9e83-5e540d6b19cd tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:48.419334 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7efba6a7-2847-4cc6-b5d8-1a86872275b2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:48.422684 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-65829af4-4f85-4f41-9e83-5e540d6b19cd tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1547 microversion: 2.1 time: 0.218273 Jul 12 17:28:48.423258 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 203/428] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:48 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1547 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:48.426603 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7efba6a7-2847-4cc6-b5d8-1a86872275b2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1509 microversion: 2.1 time: 0.196785 Jul 12 17:28:48.427154 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 226/429] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:48 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:48.438857 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-361dd45f-41d3-4491-a5b6-e836267e6b90 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:48.439466 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-361dd45f-41d3-4491-a5b6-e836267e6b90 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:48.445293 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-361dd45f-41d3-4491-a5b6-e836267e6b90 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:48.446035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-361dd45f-41d3-4491-a5b6-e836267e6b90 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:48.446798 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-361dd45f-41d3-4491-a5b6-e836267e6b90 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:48.447237 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-361dd45f-41d3-4491-a5b6-e836267e6b90 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:48.460093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6b7a947d-2bce-4315-9e55-b317e6a66e69 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:48.460741 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6b7a947d-2bce-4315-9e55-b317e6a66e69 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:48.467195 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b7a947d-2bce-4315-9e55-b317e6a66e69 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:48.467708 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b7a947d-2bce-4315-9e55-b317e6a66e69 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:48.468529 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b7a947d-2bce-4315-9e55-b317e6a66e69 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:48.469025 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6b7a947d-2bce-4315-9e55-b317e6a66e69 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:48.638517 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-361dd45f-41d3-4491-a5b6-e836267e6b90 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:48.642852 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6b7a947d-2bce-4315-9e55-b317e6a66e69 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:48.645957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-361dd45f-41d3-4491-a5b6-e836267e6b90 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1547 microversion: 2.1 time: 0.210898 Jul 12 17:28:48.650892 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 204/430] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:48 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1547 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:48.651121 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6b7a947d-2bce-4315-9e55-b317e6a66e69 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1314 microversion: 2.1 time: 0.194053 Jul 12 17:28:48.651121 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 227/431] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:48 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:48.666560 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d81c7439-8697-4559-8d49-26187a0802ea tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:48.670214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d81c7439-8697-4559-8d49-26187a0802ea tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:48.671119 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d81c7439-8697-4559-8d49-26187a0802ea tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Searching by: {'deleted': False, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e'} {{(pid=117939) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 17:28:48.677946 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d81c7439-8697-4559-8d49-26187a0802ea tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:48.678387 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d81c7439-8697-4559-8d49-26187a0802ea tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:48.679179 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d81c7439-8697-4559-8d49-26187a0802ea tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:48.679607 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d81c7439-8697-4559-8d49-26187a0802ea tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:48.772324 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.multi_cell_list [None req-d81c7439-8697-4559-8d49-26187a0802ea tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117939) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 17:28:48.863454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d81c7439-8697-4559-8d49-26187a0802ea tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.202147 Jul 12 17:28:48.864259 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 205/432] 10.222.0.62 () {58 vars in 1124 bytes} [Tue Jul 12 17:28:48 2022] GET /compute/v2.1/servers => generated 342 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:28:48.875132 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d3de8fba-ab86-441e-80ac-32fd4dbe0d65 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:48.875821 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d3de8fba-ab86-441e-80ac-32fd4dbe0d65 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:48.881712 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d3de8fba-ab86-441e-80ac-32fd4dbe0d65 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:48.882237 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d3de8fba-ab86-441e-80ac-32fd4dbe0d65 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:48.882996 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d3de8fba-ab86-441e-80ac-32fd4dbe0d65 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:48.883422 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d3de8fba-ab86-441e-80ac-32fd4dbe0d65 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:49.018532 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d3de8fba-ab86-441e-80ac-32fd4dbe0d65 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:49.026001 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d3de8fba-ab86-441e-80ac-32fd4dbe0d65 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1547 microversion: 2.1 time: 0.155520 Jul 12 17:28:49.026578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 228/433] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:48 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:49.443541 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-235b3ae6-8d21-4b03-95aa-2155b3142fb8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:49.444146 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-235b3ae6-8d21-4b03-95aa-2155b3142fb8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:49.450709 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-235b3ae6-8d21-4b03-95aa-2155b3142fb8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:49.451138 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-235b3ae6-8d21-4b03-95aa-2155b3142fb8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:49.451893 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-235b3ae6-8d21-4b03-95aa-2155b3142fb8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:49.452354 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-235b3ae6-8d21-4b03-95aa-2155b3142fb8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:49.582126 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-235b3ae6-8d21-4b03-95aa-2155b3142fb8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:49.589371 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-235b3ae6-8d21-4b03-95aa-2155b3142fb8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1509 microversion: 2.1 time: 0.149997 Jul 12 17:28:49.590462 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 206/434] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:49 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:49.667580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7cea2c48-309d-4e12-87e8-4277e349d116 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:49.668876 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7cea2c48-309d-4e12-87e8-4277e349d116 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:49.674752 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7cea2c48-309d-4e12-87e8-4277e349d116 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:49.675191 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7cea2c48-309d-4e12-87e8-4277e349d116 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:49.675932 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7cea2c48-309d-4e12-87e8-4277e349d116 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:49.676357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7cea2c48-309d-4e12-87e8-4277e349d116 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:49.807593 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7cea2c48-309d-4e12-87e8-4277e349d116 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:49.815629 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7cea2c48-309d-4e12-87e8-4277e349d116 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1499 microversion: 2.1 time: 0.151867 Jul 12 17:28:49.816289 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 229/435] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:49 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1499 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:50.538345 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c1112348-ad24-4ddf-a16f-43e195e9a125 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e92f4d5b-3822-4541-bb3f-a774ddd94ac2"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:28:50.539995 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c1112348-ad24-4ddf-a16f-43e195e9a125 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:50.547702 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c1112348-ad24-4ddf-a16f-43e195e9a125 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:50.548159 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c1112348-ad24-4ddf-a16f-43e195e9a125 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:50.548936 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c1112348-ad24-4ddf-a16f-43e195e9a125 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:50.549377 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c1112348-ad24-4ddf-a16f-43e195e9a125 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:50.588881 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8242d6e9-b8dc-4401-8aab-19b179f4a699 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:50.589730 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8242d6e9-b8dc-4401-8aab-19b179f4a699 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:50.595830 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8242d6e9-b8dc-4401-8aab-19b179f4a699 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:50.596453 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8242d6e9-b8dc-4401-8aab-19b179f4a699 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:50.597750 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8242d6e9-b8dc-4401-8aab-19b179f4a699 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:50.598305 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8242d6e9-b8dc-4401-8aab-19b179f4a699 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:50.624248 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8242d6e9-b8dc-4401-8aab-19b179f4a699 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:28:50.701023 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8242d6e9-b8dc-4401-8aab-19b179f4a699 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 204 len: 0 microversion: 2.1 time: 0.116120 Jul 12 17:28:50.704720 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 230/436] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:28:50 2022] DELETE /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 17:28:50.706564 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a736f136-394e-451a-ad2d-97f8d952a3ca tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:50.707254 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a736f136-394e-451a-ad2d-97f8d952a3ca tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:50.712931 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a736f136-394e-451a-ad2d-97f8d952a3ca tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:50.713364 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a736f136-394e-451a-ad2d-97f8d952a3ca tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:50.714173 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a736f136-394e-451a-ad2d-97f8d952a3ca tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:50.714612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a736f136-394e-451a-ad2d-97f8d952a3ca tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:50.854924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a736f136-394e-451a-ad2d-97f8d952a3ca tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:50.862787 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a736f136-394e-451a-ad2d-97f8d952a3ca tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1509 microversion: 2.1 time: 0.160071 Jul 12 17:28:50.863344 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 231/437] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:50 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:50.867799 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-89a16af3-c6c6-4158-853a-5392934eac87 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:50.868389 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-89a16af3-c6c6-4158-853a-5392934eac87 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:50.877890 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-89a16af3-c6c6-4158-853a-5392934eac87 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:50.878394 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-89a16af3-c6c6-4158-853a-5392934eac87 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:50.879247 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-89a16af3-c6c6-4158-853a-5392934eac87 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:50.879905 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-89a16af3-c6c6-4158-853a-5392934eac87 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:51.014963 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-89a16af3-c6c6-4158-853a-5392934eac87 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:51.022436 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-89a16af3-c6c6-4158-853a-5392934eac87 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1505 microversion: 2.1 time: 0.158135 Jul 12 17:28:51.023002 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 232/438] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:50 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:51.880285 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-441c69b1-37ff-4fe1-81fb-9d17f5792954 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:51.880928 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-441c69b1-37ff-4fe1-81fb-9d17f5792954 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:51.887218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-441c69b1-37ff-4fe1-81fb-9d17f5792954 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:51.887887 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-441c69b1-37ff-4fe1-81fb-9d17f5792954 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:51.888701 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-441c69b1-37ff-4fe1-81fb-9d17f5792954 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:51.889204 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-441c69b1-37ff-4fe1-81fb-9d17f5792954 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:52.017453 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-441c69b1-37ff-4fe1-81fb-9d17f5792954 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:52.024766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-441c69b1-37ff-4fe1-81fb-9d17f5792954 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1509 microversion: 2.1 time: 0.148414 Jul 12 17:28:52.025325 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 233/439] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:51 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:52.039949 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4a0a68c9-c7d0-45d8-9706-2aa25a766a35 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:52.040553 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4a0a68c9-c7d0-45d8-9706-2aa25a766a35 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:52.047181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a0a68c9-c7d0-45d8-9706-2aa25a766a35 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:52.047623 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a0a68c9-c7d0-45d8-9706-2aa25a766a35 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:52.048369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a0a68c9-c7d0-45d8-9706-2aa25a766a35 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:52.048797 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a0a68c9-c7d0-45d8-9706-2aa25a766a35 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:52.176587 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4a0a68c9-c7d0-45d8-9706-2aa25a766a35 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:52.184420 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4a0a68c9-c7d0-45d8-9706-2aa25a766a35 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1505 microversion: 2.1 time: 0.148461 Jul 12 17:28:52.185020 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 234/440] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:52 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:53.043096 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c001ad99-d2da-4593-9d31-854d428d559d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:53.043757 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c001ad99-d2da-4593-9d31-854d428d559d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:53.049674 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c001ad99-d2da-4593-9d31-854d428d559d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:53.050143 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c001ad99-d2da-4593-9d31-854d428d559d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:53.050889 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c001ad99-d2da-4593-9d31-854d428d559d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:53.051318 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c001ad99-d2da-4593-9d31-854d428d559d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:53.181482 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c001ad99-d2da-4593-9d31-854d428d559d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:53.189804 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c001ad99-d2da-4593-9d31-854d428d559d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1509 microversion: 2.1 time: 0.151067 Jul 12 17:28:53.190359 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 235/441] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:53 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:53.201418 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a92a01ab-cb5b-49a3-8e2c-b5f0de6b6383 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:53.202072 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a92a01ab-cb5b-49a3-8e2c-b5f0de6b6383 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:53.207808 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a92a01ab-cb5b-49a3-8e2c-b5f0de6b6383 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:53.208246 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a92a01ab-cb5b-49a3-8e2c-b5f0de6b6383 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:53.208997 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a92a01ab-cb5b-49a3-8e2c-b5f0de6b6383 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:53.209425 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a92a01ab-cb5b-49a3-8e2c-b5f0de6b6383 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:53.347784 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a92a01ab-cb5b-49a3-8e2c-b5f0de6b6383 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:53.355817 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a92a01ab-cb5b-49a3-8e2c-b5f0de6b6383 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1505 microversion: 2.1 time: 0.157900 Jul 12 17:28:53.356396 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 236/442] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:53 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:54.208063 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9b39b8b1-0c2b-482e-bca5-8c2b435171a9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:54.208837 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9b39b8b1-0c2b-482e-bca5-8c2b435171a9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:54.214989 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9b39b8b1-0c2b-482e-bca5-8c2b435171a9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:54.215432 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9b39b8b1-0c2b-482e-bca5-8c2b435171a9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:54.216193 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9b39b8b1-0c2b-482e-bca5-8c2b435171a9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:54.216625 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9b39b8b1-0c2b-482e-bca5-8c2b435171a9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:54.348293 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9b39b8b1-0c2b-482e-bca5-8c2b435171a9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:54.355718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9b39b8b1-0c2b-482e-bca5-8c2b435171a9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1515 microversion: 2.1 time: 0.151721 Jul 12 17:28:54.356283 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 237/443] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:54 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:54.374647 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-90b483e8-6a5b-487c-b48b-10ef74dda0ef tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:54.375254 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-90b483e8-6a5b-487c-b48b-10ef74dda0ef tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:54.381145 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-90b483e8-6a5b-487c-b48b-10ef74dda0ef tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:54.381586 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-90b483e8-6a5b-487c-b48b-10ef74dda0ef tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:54.382382 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-90b483e8-6a5b-487c-b48b-10ef74dda0ef tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:54.382810 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-90b483e8-6a5b-487c-b48b-10ef74dda0ef tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:54.513981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-90b483e8-6a5b-487c-b48b-10ef74dda0ef tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:54.518268 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:54.523417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-90b483e8-6a5b-487c-b48b-10ef74dda0ef tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1505 microversion: 2.1 time: 0.153157 Jul 12 17:28:54.524012 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 238/444] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:54 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:54.749456 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c1112348-ad24-4ddf-a16f-43e195e9a125 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "POST /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.215270 Jul 12 17:28:54.750720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 207/445] 10.222.0.62 () {60 vars in 1322 bytes} [Tue Jul 12 17:28:50 2022] POST /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f/os-volume_attachments => generated 194 bytes in 4218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:28:55.162190 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-3b5ea7b0-db5c-4538-a897-8f06370ff76c req-bbbd9b23-f2b0-49f6-a600-0e73c8eb8c1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eff76d7-a7a3-4145-a17b-83a9e40840cb", "name": "network-vif-deleted", "tag": "b1173d06-ed5d-4496-b1f5-30ad400ccca1"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:28:55.171823 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-3b5ea7b0-db5c-4538-a897-8f06370ff76c req-bbbd9b23-f2b0-49f6-a600-0e73c8eb8c1d service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:55.172266 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-3b5ea7b0-db5c-4538-a897-8f06370ff76c req-bbbd9b23-f2b0-49f6-a600-0e73c8eb8c1d service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:55.183666 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-3b5ea7b0-db5c-4538-a897-8f06370ff76c req-bbbd9b23-f2b0-49f6-a600-0e73c8eb8c1d service nova] Creating event network-vif-deleted:b1173d06-ed5d-4496-b1f5-30ad400ccca1 for instance 1eff76d7-a7a3-4145-a17b-83a9e40840cb on hv-cinder-84932 Jul 12 17:28:55.188842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-3b5ea7b0-db5c-4538-a897-8f06370ff76c req-bbbd9b23-f2b0-49f6-a600-0e73c8eb8c1d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030841 Jul 12 17:28:55.192550 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 239/446] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:28:55.541402 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-bbbe2b9b-7196-4a18-bd71-95fd809015a9 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:55.542131 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-bbbe2b9b-7196-4a18-bd71-95fd809015a9 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:55.548369 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bbbe2b9b-7196-4a18-bd71-95fd809015a9 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:55.548816 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bbbe2b9b-7196-4a18-bd71-95fd809015a9 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:55.549577 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bbbe2b9b-7196-4a18-bd71-95fd809015a9 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:55.550042 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bbbe2b9b-7196-4a18-bd71-95fd809015a9 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:55.584654 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bbbe2b9b-7196-4a18-bd71-95fd809015a9 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:55.585033 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bbbe2b9b-7196-4a18-bd71-95fd809015a9 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:55.585490 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-bbbe2b9b-7196-4a18-bd71-95fd809015a9 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lazy-loading 'fault' on Instance uuid 1eff76d7-a7a3-4145-a17b-83a9e40840cb {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:28:55.629459 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-bbbe2b9b-7196-4a18-bd71-95fd809015a9 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:55.636811 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-bbbe2b9b-7196-4a18-bd71-95fd809015a9 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 200 len: 1304 microversion: 2.1 time: 0.100194 Jul 12 17:28:55.637374 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 208/447] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:55 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:55.762609 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bfc9de1d-f4f5-4895-a22d-e80ae27aba91 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Action: 'create', calling method: .version_select at 0x7f8729b5c280>, body: {"keypair": {"name": "tempest-keypair-1054306173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQ7PVspzpCHzo7KLttxHKOXNgUJuUni2Hb59JqGJXv8mDDJKqEOfuLqF2aZcxUn4RjClFU88ugD6zxqfn336EUkGCxgx7aWgnV4zOKn/Ba+lJtUFHxL9dlYp5MAAoQjKA=="}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:28:55.777387 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-bfc9de1d-f4f5-4895-a22d-e80ae27aba91 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Getting quotas for project 13884af024db42bcb013e475df0a53f0. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:28:55.779572 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:55.781942 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-bfc9de1d-f4f5-4895-a22d-e80ae27aba91 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Getting quotas for user 35e0364ccc1d4992932e8483e3f1f9d6 and project 13884af024db42bcb013e475df0a53f0. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:28:55.805042 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bfc9de1d-f4f5-4895-a22d-e80ae27aba91 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046633 Jul 12 17:28:55.805638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 240/448] 10.222.0.62 () {60 vars in 1158 bytes} [Tue Jul 12 17:28:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:28:56.654994 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-94d18edb-7ac6-485b-a6a3-95412e42be1a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:56.655700 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-94d18edb-7ac6-485b-a6a3-95412e42be1a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: 1eff76d7-a7a3-4145-a17b-83a9e40840cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:56.662503 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-94d18edb-7ac6-485b-a6a3-95412e42be1a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:56.663020 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-94d18edb-7ac6-485b-a6a3-95412e42be1a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:56.663854 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-94d18edb-7ac6-485b-a6a3-95412e42be1a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:56.664350 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-94d18edb-7ac6-485b-a6a3-95412e42be1a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:56.678543 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-94d18edb-7ac6-485b-a6a3-95412e42be1a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] HTTP exception thrown: Instance 1eff76d7-a7a3-4145-a17b-83a9e40840cb could not be found. Jul 12 17:28:56.680632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-94d18edb-7ac6-485b-a6a3-95412e42be1a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Request method failure captured: Jul 12 17:28:56.680632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb HTTP/1.1 Jul 12 17:28:56.680632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:28:56.680632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:28:56.680632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:28:56.680632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:28:56.680632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:28:56.680632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:28:56.680632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:28:56.680632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:28:56.680632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza8nFOeQcQYME00sSq_36UGg0oN82oxTmJmlLH7BKSqXnZ1FJ3CGO4Ln8_unLQhZwZPSicBS652YI_wnfFxmT2IVZIyyWpKZfZUJaSlxS0BollBkd884DLDV2ivQCp3nuNjZYejMFQCOmAV4XfwPKP8HzCD6SX1dTlUOOtTKtfd4LU8 Jul 12 17:28:56.680632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:28:56.680632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:28:56.680632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:28:56.680632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:28:56.680632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:28:56.680632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:28:56.680632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: fb0d32278a254e65ae2ac38b2c7a8e48 Jul 12 17:28:56.680632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-VolumesActionsTest-775230559 Jul 12 17:28:56.680632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:28:56.680632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:28:56.681962 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fb0d32278a254e65ae2ac38b2c7a8e48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fb0d32278a254e65ae2ac38b2c7a8e48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fb0d32278a254e65ae2ac38b2c7a8e48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fb0d32278a254e65ae2ac38b2c7a8e48", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:28:56.681962 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-VolumesActionsTest-775230559 Jul 12 17:28:56.681962 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: fb0d32278a254e65ae2ac38b2c7a8e48 Jul 12 17:28:56.681962 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-VolumesActionsTest-775230559 Jul 12 17:28:56.681962 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-VolumesActionsTest-775230559-project Jul 12 17:28:56.681962 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:28:56.681962 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:28:56.681962 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: be175ae71d25489c82ab8e558a93e003 Jul 12 17:28:56.681962 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-VolumesActionsTest-775230559-project Jul 12 17:28:56.681962 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:28:56.681962 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance 1eff76d7-a7a3-4145-a17b-83a9e40840cb could not be found. Jul 12 17:28:56.681962 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': '1eff76d7-a7a3-4145-a17b-83a9e40840cb'} Jul 12 17:28:56.682740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:28:56.682740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:28:56.682740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:28:56.682740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:28:56.682740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:28:56.682740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:28:56.682740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:28:56.682740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:28:56.682740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:28:56.682740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:28:56.682740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eff76d7-a7a3-4145-a17b-83a9e40840cb could not be found. Jul 12 17:28:56.682740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:28:56.682740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:28:56.682740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:28:56.682740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:28:56.682740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:28:56.682740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:28:56.682740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:28:56.682740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:28:56.682740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:28:56.683963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:28:56.683963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:28:56.683963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:28:56.683963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:28:56.683963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:28:56.683963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:28:56.683963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:28:56.683963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eff76d7-a7a3-4145-a17b-83a9e40840cb could not be found. Jul 12 17:28:56.683963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:28:56.683963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:28:56.683963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:28:56.683963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:28:56.683963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:28:56.683963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:28:56.683963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:28:56.683963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:28:56.683963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eff76d7-a7a3-4145-a17b-83a9e40840cb could not be found. Jul 12 17:28:56.683963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:28:56.686003 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-94d18edb-7ac6-485b-a6a3-95412e42be1a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Returning 404 to user: Instance 1eff76d7-a7a3-4145-a17b-83a9e40840cb could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:28:56.686862 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-94d18edb-7ac6-485b-a6a3-95412e42be1a tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb" status: 404 len: 111 microversion: 2.1 time: 0.036443 Jul 12 17:28:56.688073 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 209/449] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:56 2022] GET /compute/v2.1/servers/1eff76d7-a7a3-4145-a17b-83a9e40840cb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:28:56.816748 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d5c8ff1e-30bb-4b4f-bd04-a32318af896b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-502578281", "imageRef": "b19e7830-75c9-4706-bd34-4954ba6b4cc1", "flavorRef": "452", "networks": [{"uuid": "faf5a3e6-041b-4d44-8f2e-8f0cc2e1560a"}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:28:56.878192 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-d5c8ff1e-30bb-4b4f-bd04-a32318af896b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] validate_networks() for [('faf5a3e6-041b-4d44-8f2e-8f0cc2e1560a', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:28:57.260108 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-d5c8ff1e-30bb-4b4f-bd04-a32318af896b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:28:57.260534 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-d5c8ff1e-30bb-4b4f-bd04-a32318af896b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:28:57.261012 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-d5c8ff1e-30bb-4b4f-bd04-a32318af896b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:28:57.261433 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-d5c8ff1e-30bb-4b4f-bd04-a32318af896b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:28:57.261912 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-d5c8ff1e-30bb-4b4f-bd04-a32318af896b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:28:57.271191 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d5c8ff1e-30bb-4b4f-bd04-a32318af896b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:57.271646 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d5c8ff1e-30bb-4b4f-bd04-a32318af896b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:57.272449 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d5c8ff1e-30bb-4b4f-bd04-a32318af896b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:57.272883 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d5c8ff1e-30bb-4b4f-bd04-a32318af896b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:57.289325 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-d5c8ff1e-30bb-4b4f-bd04-a32318af896b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Getting quotas for project fb0d32278a254e65ae2ac38b2c7a8e48. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:28:57.293319 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-d5c8ff1e-30bb-4b4f-bd04-a32318af896b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Getting quotas for user be175ae71d25489c82ab8e558a93e003 and project fb0d32278a254e65ae2ac38b2c7a8e48. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:28:57.305025 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d5c8ff1e-30bb-4b4f-bd04-a32318af896b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:28:57.307773 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d5c8ff1e-30bb-4b4f-bd04-a32318af896b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19e7830-75c9-4706-bd34-4954ba6b4cc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:28:57.321888 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-62ecc08c-8aaf-4842-8b0a-5bc2eb368864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1566397585", "imageRef": "b19e7830-75c9-4706-bd34-4954ba6b4cc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a270b63-04b7-42b7-ba5e-a9545ef80e4a"}], "security_groups": [{"name": "tempest-securitygroup--960771871"}], "key_name": "tempest-keypair-1054306173", "user_data": "}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:28:57.354015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d5c8ff1e-30bb-4b4f-bd04-a32318af896b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543011 Jul 12 17:28:57.354666 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 241/450] 10.222.0.62 () {60 vars in 1146 bytes} [Tue Jul 12 17:28:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:28:57.365190 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-76884625-dae6-48e0-89c8-a9e3c3ae2c1d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:57.366130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-76884625-dae6-48e0-89c8-a9e3c3ae2c1d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:57.441667 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-76884625-dae6-48e0-89c8-a9e3c3ae2c1d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:57.448753 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-76884625-dae6-48e0-89c8-a9e3c3ae2c1d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 200 len: 1213 microversion: 2.1 time: 0.087279 Jul 12 17:28:57.449323 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 242/451] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:57 2022] GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:28:57.478914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.network.neutron [None req-62ecc08c-8aaf-4842-8b0a-5bc2eb368864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] validate_networks() for [('5a270b63-04b7-42b7-ba5e-a9545ef80e4a', None, None, None, None, None)] {{(pid=117939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:28:57.888734 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-62ecc08c-8aaf-4842-8b0a-5bc2eb368864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Flavor limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:28:57.889307 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-62ecc08c-8aaf-4842-8b0a-5bc2eb368864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Image limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:28:57.889601 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-62ecc08c-8aaf-4842-8b0a-5bc2eb368864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Flavor pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:28:57.890031 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-62ecc08c-8aaf-4842-8b0a-5bc2eb368864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Image pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:28:57.890434 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-62ecc08c-8aaf-4842-8b0a-5bc2eb368864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:28:57.899170 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-62ecc08c-8aaf-4842-8b0a-5bc2eb368864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:57.899611 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-62ecc08c-8aaf-4842-8b0a-5bc2eb368864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:57.900397 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-62ecc08c-8aaf-4842-8b0a-5bc2eb368864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:57.900828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-62ecc08c-8aaf-4842-8b0a-5bc2eb368864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:57.918059 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-62ecc08c-8aaf-4842-8b0a-5bc2eb368864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Getting quotas for project 13884af024db42bcb013e475df0a53f0. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:28:57.923025 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-62ecc08c-8aaf-4842-8b0a-5bc2eb368864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Getting quotas for user 35e0364ccc1d4992932e8483e3f1f9d6 and project 13884af024db42bcb013e475df0a53f0. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:28:57.934603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-62ecc08c-8aaf-4842-8b0a-5bc2eb368864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Going to run 1 instances... {{(pid=117939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:28:57.936796 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-62ecc08c-8aaf-4842-8b0a-5bc2eb368864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19e7830-75c9-4706-bd34-4954ba6b4cc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:28:57.987136 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-62ecc08c-8aaf-4842-8b0a-5bc2eb368864 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.670171 Jul 12 17:28:57.988678 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 210/452] 10.222.0.62 () {60 vars in 1146 bytes} [Tue Jul 12 17:28:57 2022] POST /compute/v2.1/servers => generated 408 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:28:57.999316 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-48345573-03ed-455d-a66d-e002ac205ac9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:58.000649 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-48345573-03ed-455d-a66d-e002ac205ac9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:58.064793 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-48345573-03ed-455d-a66d-e002ac205ac9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:58.072973 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-48345573-03ed-455d-a66d-e002ac205ac9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1246 microversion: 2.1 time: 0.078662 Jul 12 17:28:58.073556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 243/453] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:57 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1246 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:58.466266 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e432a625-1add-4fae-aa8e-821b0505ed36 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:58.466890 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e432a625-1add-4fae-aa8e-821b0505ed36 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:58.473721 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e432a625-1add-4fae-aa8e-821b0505ed36 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:58.474181 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e432a625-1add-4fae-aa8e-821b0505ed36 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:58.474959 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e432a625-1add-4fae-aa8e-821b0505ed36 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:58.475401 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e432a625-1add-4fae-aa8e-821b0505ed36 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:58.535967 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e432a625-1add-4fae-aa8e-821b0505ed36 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:58.543265 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e432a625-1add-4fae-aa8e-821b0505ed36 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 200 len: 1209 microversion: 2.1 time: 0.081633 Jul 12 17:28:58.543833 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 211/454] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:58 2022] GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 1209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:59.090438 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-27c26a2d-842a-42ed-a032-ee8a245ac790 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:59.090958 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-27c26a2d-842a-42ed-a032-ee8a245ac790 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:59.097328 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-27c26a2d-842a-42ed-a032-ee8a245ac790 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:59.097819 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-27c26a2d-842a-42ed-a032-ee8a245ac790 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:59.098591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-27c26a2d-842a-42ed-a032-ee8a245ac790 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:59.099030 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-27c26a2d-842a-42ed-a032-ee8a245ac790 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:59.167464 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-27c26a2d-842a-42ed-a032-ee8a245ac790 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:59.175437 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-27c26a2d-842a-42ed-a032-ee8a245ac790 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1298 microversion: 2.1 time: 0.089007 Jul 12 17:28:59.176006 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 244/455] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:59 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:28:59.560354 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5dd9defc-9aec-4893-a6f7-07340f5b0a30 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:28:59.561043 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5dd9defc-9aec-4893-a6f7-07340f5b0a30 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:28:59.580385 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5dd9defc-9aec-4893-a6f7-07340f5b0a30 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:59.581136 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5dd9defc-9aec-4893-a6f7-07340f5b0a30 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:59.582597 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5dd9defc-9aec-4893-a6f7-07340f5b0a30 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:28:59.582597 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5dd9defc-9aec-4893-a6f7-07340f5b0a30 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:28:59.669438 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5dd9defc-9aec-4893-a6f7-07340f5b0a30 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:28:59.688069 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5dd9defc-9aec-4893-a6f7-07340f5b0a30 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 200 len: 1273 microversion: 2.1 time: 0.131419 Jul 12 17:28:59.696142 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 212/456] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:28:59 2022] GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 1273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:00.192230 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2faf96de-2948-433c-b3b2-c88bdb7ef221 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:00.192956 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2faf96de-2948-433c-b3b2-c88bdb7ef221 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:00.199592 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2faf96de-2948-433c-b3b2-c88bdb7ef221 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:00.200111 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2faf96de-2948-433c-b3b2-c88bdb7ef221 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:00.200975 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2faf96de-2948-433c-b3b2-c88bdb7ef221 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:00.201461 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2faf96de-2948-433c-b3b2-c88bdb7ef221 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:00.304331 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2faf96de-2948-433c-b3b2-c88bdb7ef221 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:00.311633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2faf96de-2948-433c-b3b2-c88bdb7ef221 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1304 microversion: 2.1 time: 0.123228 Jul 12 17:29:00.312196 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 245/457] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:00 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:00.708342 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cf5766b0-3d81-42a9-bdd6-4cc8f909a555 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:00.709641 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-cf5766b0-3d81-42a9-bdd6-4cc8f909a555 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:00.711096 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:00.716644 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cf5766b0-3d81-42a9-bdd6-4cc8f909a555 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:00.717287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cf5766b0-3d81-42a9-bdd6-4cc8f909a555 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:00.718151 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cf5766b0-3d81-42a9-bdd6-4cc8f909a555 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:00.723841 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cf5766b0-3d81-42a9-bdd6-4cc8f909a555 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:00.960971 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cf5766b0-3d81-42a9-bdd6-4cc8f909a555 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:00.968098 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-cf5766b0-3d81-42a9-bdd6-4cc8f909a555 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 200 len: 1313 microversion: 2.1 time: 0.265358 Jul 12 17:29:00.968963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 213/458] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:00 2022] GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:01.328782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-942fb014-9a26-4b1a-8958-0fd7b46a0697 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:01.329561 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-942fb014-9a26-4b1a-8958-0fd7b46a0697 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:01.335607 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-942fb014-9a26-4b1a-8958-0fd7b46a0697 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:01.336057 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-942fb014-9a26-4b1a-8958-0fd7b46a0697 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:01.336820 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-942fb014-9a26-4b1a-8958-0fd7b46a0697 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:01.337253 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-942fb014-9a26-4b1a-8958-0fd7b46a0697 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:01.618284 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-942fb014-9a26-4b1a-8958-0fd7b46a0697 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:01.626963 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-942fb014-9a26-4b1a-8958-0fd7b46a0697 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1371 microversion: 2.1 time: 0.302434 Jul 12 17:29:01.627580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 246/459] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:01 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1371 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:01.900342 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-f184d4d7-0c80-4d48-ad83-bcb7a0fee75a req-0d83432b-c64a-4976-90c8-33eb44cb5d4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eedcd296-5cc8-496c-9285-6a6d001811e6", "tag": "c315ba00-73a2-4638-a32f-23677b161d7d"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:29:01.912015 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-f184d4d7-0c80-4d48-ad83-bcb7a0fee75a req-0d83432b-c64a-4976-90c8-33eb44cb5d4b service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:01.912515 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-f184d4d7-0c80-4d48-ad83-bcb7a0fee75a req-0d83432b-c64a-4976-90c8-33eb44cb5d4b service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:01.931539 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-f184d4d7-0c80-4d48-ad83-bcb7a0fee75a req-0d83432b-c64a-4976-90c8-33eb44cb5d4b service nova] Creating event network-changed:c315ba00-73a2-4638-a32f-23677b161d7d for instance eedcd296-5cc8-496c-9285-6a6d001811e6 on hv-cinder-84932 Jul 12 17:29:01.937028 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-f184d4d7-0c80-4d48-ad83-bcb7a0fee75a req-0d83432b-c64a-4976-90c8-33eb44cb5d4b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040588 Jul 12 17:29:01.937600 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 214/460] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:29:01.984772 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-92ff7b82-0b0b-4e39-b7c3-9b5726c72ee1 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:01.985382 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-92ff7b82-0b0b-4e39-b7c3-9b5726c72ee1 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:01.991405 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-92ff7b82-0b0b-4e39-b7c3-9b5726c72ee1 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:01.991871 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-92ff7b82-0b0b-4e39-b7c3-9b5726c72ee1 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:01.992637 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-92ff7b82-0b0b-4e39-b7c3-9b5726c72ee1 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:01.993069 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-92ff7b82-0b0b-4e39-b7c3-9b5726c72ee1 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:02.220097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-92ff7b82-0b0b-4e39-b7c3-9b5726c72ee1 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:02.228028 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-92ff7b82-0b0b-4e39-b7c3-9b5726c72ee1 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 200 len: 1313 microversion: 2.1 time: 0.247659 Jul 12 17:29:02.228588 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 247/461] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:01 2022] GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:02.644734 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2a2f6611-336d-40d4-be23-e4f0b4d32b5b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:02.645809 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2a2f6611-336d-40d4-be23-e4f0b4d32b5b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:02.654400 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2a2f6611-336d-40d4-be23-e4f0b4d32b5b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:02.654982 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2a2f6611-336d-40d4-be23-e4f0b4d32b5b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:02.655981 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2a2f6611-336d-40d4-be23-e4f0b4d32b5b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:02.656528 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2a2f6611-336d-40d4-be23-e4f0b4d32b5b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:02.916090 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2a2f6611-336d-40d4-be23-e4f0b4d32b5b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:02.925782 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2a2f6611-336d-40d4-be23-e4f0b4d32b5b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1371 microversion: 2.1 time: 0.285563 Jul 12 17:29:02.926460 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 215/462] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:02 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1371 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:03.244817 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e531b217-0b02-402b-8394-a59c10bba9ad tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:03.245437 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e531b217-0b02-402b-8394-a59c10bba9ad tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:03.254819 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e531b217-0b02-402b-8394-a59c10bba9ad tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:03.255276 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e531b217-0b02-402b-8394-a59c10bba9ad tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:03.256055 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e531b217-0b02-402b-8394-a59c10bba9ad tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:03.256495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e531b217-0b02-402b-8394-a59c10bba9ad tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:03.432020 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ecdfb796-7c37-4c74-8568-9ac382050db7 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:03.432644 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ecdfb796-7c37-4c74-8568-9ac382050db7 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:03.438631 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ecdfb796-7c37-4c74-8568-9ac382050db7 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:03.439264 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ecdfb796-7c37-4c74-8568-9ac382050db7 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:03.440177 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ecdfb796-7c37-4c74-8568-9ac382050db7 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:03.440779 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ecdfb796-7c37-4c74-8568-9ac382050db7 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:03.600187 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e531b217-0b02-402b-8394-a59c10bba9ad tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:03.608206 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e531b217-0b02-402b-8394-a59c10bba9ad tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 200 len: 1313 microversion: 2.1 time: 0.367084 Jul 12 17:29:03.609076 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 248/463] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:03 2022] GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:03.787253 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ecdfb796-7c37-4c74-8568-9ac382050db7 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:03.795432 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ecdfb796-7c37-4c74-8568-9ac382050db7 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1593 microversion: 2.1 time: 0.367099 Jul 12 17:29:03.796302 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 216/464] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:03 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1593 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:29:03.942476 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-acb5cf4f-2210-4df8-9ace-fd929fbcfc53 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:03.943217 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-acb5cf4f-2210-4df8-9ace-fd929fbcfc53 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:03.949595 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-acb5cf4f-2210-4df8-9ace-fd929fbcfc53 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:03.950139 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-acb5cf4f-2210-4df8-9ace-fd929fbcfc53 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:03.951499 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-acb5cf4f-2210-4df8-9ace-fd929fbcfc53 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:03.951939 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-acb5cf4f-2210-4df8-9ace-fd929fbcfc53 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:03.952433 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-3229dbc9-de45-4251-9a1f-4e2147c4f9a4 req-68c7247e-a5bc-41a2-b8e4-c7f7afd864de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e5af452-8518-42e8-b587-1d1fe57554c9", "tag": "b3ccbfc5-0e69-441b-9bcc-1d315b0bf93c"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:29:03.961361 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-3229dbc9-de45-4251-9a1f-4e2147c4f9a4 req-68c7247e-a5bc-41a2-b8e4-c7f7afd864de service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:03.961636 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-3229dbc9-de45-4251-9a1f-4e2147c4f9a4 req-68c7247e-a5bc-41a2-b8e4-c7f7afd864de service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:03.973007 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-3229dbc9-de45-4251-9a1f-4e2147c4f9a4 req-68c7247e-a5bc-41a2-b8e4-c7f7afd864de service nova] Creating event network-changed:b3ccbfc5-0e69-441b-9bcc-1d315b0bf93c for instance 0e5af452-8518-42e8-b587-1d1fe57554c9 on hv-cinder-84932 Jul 12 17:29:03.977731 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-3229dbc9-de45-4251-9a1f-4e2147c4f9a4 req-68c7247e-a5bc-41a2-b8e4-c7f7afd864de service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029753 Jul 12 17:29:03.978633 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 217/465] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:29:04.082071 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-acb5cf4f-2210-4df8-9ace-fd929fbcfc53 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:04.089403 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-acb5cf4f-2210-4df8-9ace-fd929fbcfc53 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1371 microversion: 2.1 time: 0.150850 Jul 12 17:29:04.090023 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 249/466] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:03 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:04.626369 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7d97e196-6f60-4e6f-b439-e47fdcf7df29 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:04.626987 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7d97e196-6f60-4e6f-b439-e47fdcf7df29 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:04.633093 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7d97e196-6f60-4e6f-b439-e47fdcf7df29 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:04.633547 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7d97e196-6f60-4e6f-b439-e47fdcf7df29 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:04.634348 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7d97e196-6f60-4e6f-b439-e47fdcf7df29 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:04.634784 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7d97e196-6f60-4e6f-b439-e47fdcf7df29 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:04.652764 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:04.774114 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7d97e196-6f60-4e6f-b439-e47fdcf7df29 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:04.782210 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7d97e196-6f60-4e6f-b439-e47fdcf7df29 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 200 len: 1313 microversion: 2.1 time: 0.160154 Jul 12 17:29:04.782803 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 218/467] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:04 2022] GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:05.106639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d16f37db-147e-439b-a12a-7184fec948e7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:05.107415 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d16f37db-147e-439b-a12a-7184fec948e7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:05.113481 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d16f37db-147e-439b-a12a-7184fec948e7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:05.113956 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d16f37db-147e-439b-a12a-7184fec948e7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:05.115019 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d16f37db-147e-439b-a12a-7184fec948e7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:05.115445 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d16f37db-147e-439b-a12a-7184fec948e7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:05.244771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d16f37db-147e-439b-a12a-7184fec948e7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:05.252940 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d16f37db-147e-439b-a12a-7184fec948e7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1371 microversion: 2.1 time: 0.150457 Jul 12 17:29:05.253474 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 250/468] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:05 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:05.731150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-7c94d3db-d2a0-434a-ba6f-6a8b647c5698 req-4495a5c3-2f43-45c1-a389-ab9ded856553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad9cb42e-ab4c-4156-8944-5c8ddd677b0f", "tag": "e5729bfd-6f0d-43dc-88e8-b8b9b0480a96"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:29:05.740244 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-7c94d3db-d2a0-434a-ba6f-6a8b647c5698 req-4495a5c3-2f43-45c1-a389-ab9ded856553 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:05.741041 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-7c94d3db-d2a0-434a-ba6f-6a8b647c5698 req-4495a5c3-2f43-45c1-a389-ab9ded856553 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:05.753403 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-7c94d3db-d2a0-434a-ba6f-6a8b647c5698 req-4495a5c3-2f43-45c1-a389-ab9ded856553 service nova] Creating event network-changed:e5729bfd-6f0d-43dc-88e8-b8b9b0480a96 for instance ad9cb42e-ab4c-4156-8944-5c8ddd677b0f on hv-cinder-84932 Jul 12 17:29:05.759003 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-7c94d3db-d2a0-434a-ba6f-6a8b647c5698 req-4495a5c3-2f43-45c1-a389-ab9ded856553 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031638 Jul 12 17:29:05.759807 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 219/469] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:29:05.799600 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3edfeb3f-ed25-4106-8fde-e0e1452d6e20 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:05.800260 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3edfeb3f-ed25-4106-8fde-e0e1452d6e20 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:05.807038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3edfeb3f-ed25-4106-8fde-e0e1452d6e20 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:05.807493 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3edfeb3f-ed25-4106-8fde-e0e1452d6e20 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:05.808266 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3edfeb3f-ed25-4106-8fde-e0e1452d6e20 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:05.808829 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3edfeb3f-ed25-4106-8fde-e0e1452d6e20 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:05.980674 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3edfeb3f-ed25-4106-8fde-e0e1452d6e20 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:05.990391 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3edfeb3f-ed25-4106-8fde-e0e1452d6e20 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 200 len: 1313 microversion: 2.1 time: 0.195494 Jul 12 17:29:06.000251 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 251/470] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:05 2022] GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:06.270338 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-83bb51ac-7211-4fce-87dc-02649804a5e9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:06.271119 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-83bb51ac-7211-4fce-87dc-02649804a5e9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:06.281310 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-83bb51ac-7211-4fce-87dc-02649804a5e9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:06.282393 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-83bb51ac-7211-4fce-87dc-02649804a5e9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:06.283595 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-83bb51ac-7211-4fce-87dc-02649804a5e9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:06.284047 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-83bb51ac-7211-4fce-87dc-02649804a5e9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:06.432859 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-83bb51ac-7211-4fce-87dc-02649804a5e9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:06.440932 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-83bb51ac-7211-4fce-87dc-02649804a5e9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1371 microversion: 2.1 time: 0.175024 Jul 12 17:29:06.441523 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 220/471] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:06 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:06.742025 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-92e246f4-7b62-4f38-9e62-d191792fd5c3 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1672962216"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:29:06.742563 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-92e246f4-7b62-4f38-9e62-d191792fd5c3 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:06.749023 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-92e246f4-7b62-4f38-9e62-d191792fd5c3 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:06.749474 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-92e246f4-7b62-4f38-9e62-d191792fd5c3 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:06.750268 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-92e246f4-7b62-4f38-9e62-d191792fd5c3 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:06.750701 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-92e246f4-7b62-4f38-9e62-d191792fd5c3 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:06.882674 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.network.security_group_api [None req-92e246f4-7b62-4f38-9e62-d191792fd5c3 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Adding security group 41bbe724-e5bc-42fc-8477-b10a0f04af5c to port e5729bfd-6f0d-43dc-88e8-b8b9b0480a96 Jul 12 17:29:07.007334 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-154c8855-f009-4dfa-8330-d9f4e6a423fc tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:07.008259 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-154c8855-f009-4dfa-8330-d9f4e6a423fc tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:07.015625 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-154c8855-f009-4dfa-8330-d9f4e6a423fc tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:07.016073 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-154c8855-f009-4dfa-8330-d9f4e6a423fc tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:07.016879 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-154c8855-f009-4dfa-8330-d9f4e6a423fc tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:07.017311 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-154c8855-f009-4dfa-8330-d9f4e6a423fc tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:07.281143 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:07.452286 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-154c8855-f009-4dfa-8330-d9f4e6a423fc tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:07.459701 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-154c8855-f009-4dfa-8330-d9f4e6a423fc tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 200 len: 1313 microversion: 2.1 time: 0.456372 Jul 12 17:29:07.460261 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 221/472] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:07 2022] GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:29:07.465198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-391377ab-02ae-4b31-bd0a-ed0f4f0c3a1e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:07.465845 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-391377ab-02ae-4b31-bd0a-ed0f4f0c3a1e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:07.472237 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-391377ab-02ae-4b31-bd0a-ed0f4f0c3a1e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:07.473424 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-391377ab-02ae-4b31-bd0a-ed0f4f0c3a1e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:07.474570 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-391377ab-02ae-4b31-bd0a-ed0f4f0c3a1e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:07.475159 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-391377ab-02ae-4b31-bd0a-ed0f4f0c3a1e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:07.557820 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-92e246f4-7b62-4f38-9e62-d191792fd5c3 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "POST /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f/action" status: 202 len: 0 microversion: 2.1 time: 0.819743 Jul 12 17:29:07.558440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 252/473] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Jul 12 17:29:06 2022] POST /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f/action => generated 0 bytes in 821 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:29:07.569908 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e3a26e5c-061c-40de-9298-db9c135b8390 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:07.570780 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e3a26e5c-061c-40de-9298-db9c135b8390 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:07.580547 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e3a26e5c-061c-40de-9298-db9c135b8390 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:07.581479 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e3a26e5c-061c-40de-9298-db9c135b8390 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:07.582516 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e3a26e5c-061c-40de-9298-db9c135b8390 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:07.583802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e3a26e5c-061c-40de-9298-db9c135b8390 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:07.660555 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-391377ab-02ae-4b31-bd0a-ed0f4f0c3a1e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:07.675382 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-391377ab-02ae-4b31-bd0a-ed0f4f0c3a1e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1371 microversion: 2.1 time: 0.213962 Jul 12 17:29:07.684075 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 222/474] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:07 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:07.690845 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-83bc8264-70b8-4c3b-8186-fbd7e3b32e76 req-be6b8221-918e-45cd-bdda-5fe5d795f223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad9cb42e-ab4c-4156-8944-5c8ddd677b0f", "tag": "e5729bfd-6f0d-43dc-88e8-b8b9b0480a96"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:29:07.700714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-83bc8264-70b8-4c3b-8186-fbd7e3b32e76 req-be6b8221-918e-45cd-bdda-5fe5d795f223 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:07.701360 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-83bc8264-70b8-4c3b-8186-fbd7e3b32e76 req-be6b8221-918e-45cd-bdda-5fe5d795f223 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:07.717587 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-83bc8264-70b8-4c3b-8186-fbd7e3b32e76 req-be6b8221-918e-45cd-bdda-5fe5d795f223 service nova] Creating event network-changed:e5729bfd-6f0d-43dc-88e8-b8b9b0480a96 for instance ad9cb42e-ab4c-4156-8944-5c8ddd677b0f on hv-cinder-84932 Jul 12 17:29:07.725520 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-83bc8264-70b8-4c3b-8186-fbd7e3b32e76 req-be6b8221-918e-45cd-bdda-5fe5d795f223 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039098 Jul 12 17:29:07.736528 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 223/475] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:29:07.782588 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e3a26e5c-061c-40de-9298-db9c135b8390 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:07.791983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e3a26e5c-061c-40de-9298-db9c135b8390 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1640 microversion: 2.1 time: 0.228694 Jul 12 17:29:07.792513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 253/476] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:07 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1640 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:08.477711 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ec38d487-12e1-4306-8a3e-c8169291838d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:08.478413 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ec38d487-12e1-4306-8a3e-c8169291838d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:08.480307 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=4 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:08.480960 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=6 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:08.487278 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ec38d487-12e1-4306-8a3e-c8169291838d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:08.487720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ec38d487-12e1-4306-8a3e-c8169291838d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:08.488475 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ec38d487-12e1-4306-8a3e-c8169291838d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:08.488907 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ec38d487-12e1-4306-8a3e-c8169291838d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:08.618165 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ec38d487-12e1-4306-8a3e-c8169291838d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:08.626069 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ec38d487-12e1-4306-8a3e-c8169291838d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 200 len: 1313 microversion: 2.1 time: 0.152590 Jul 12 17:29:08.626625 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 224/477] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:08 2022] GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:08.692432 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bed01690-2b82-4389-b58d-8cadeb95d9e1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:08.693029 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bed01690-2b82-4389-b58d-8cadeb95d9e1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:08.694960 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=14 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:08.700966 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bed01690-2b82-4389-b58d-8cadeb95d9e1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:08.701410 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bed01690-2b82-4389-b58d-8cadeb95d9e1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:08.702202 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bed01690-2b82-4389-b58d-8cadeb95d9e1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:08.702632 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bed01690-2b82-4389-b58d-8cadeb95d9e1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:08.833988 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bed01690-2b82-4389-b58d-8cadeb95d9e1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:08.841246 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bed01690-2b82-4389-b58d-8cadeb95d9e1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1371 microversion: 2.1 time: 0.152733 Jul 12 17:29:08.841864 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 254/478] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:08 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:29:09.642567 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b8df47c6-c251-4d98-b0c3-50ca55e8e59b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:09.643175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b8df47c6-c251-4d98-b0c3-50ca55e8e59b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:09.649593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b8df47c6-c251-4d98-b0c3-50ca55e8e59b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:09.650068 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b8df47c6-c251-4d98-b0c3-50ca55e8e59b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:09.650823 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b8df47c6-c251-4d98-b0c3-50ca55e8e59b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:09.651254 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b8df47c6-c251-4d98-b0c3-50ca55e8e59b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:09.777615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b8df47c6-c251-4d98-b0c3-50ca55e8e59b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:09.784966 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b8df47c6-c251-4d98-b0c3-50ca55e8e59b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 200 len: 1313 microversion: 2.1 time: 0.146716 Jul 12 17:29:09.785517 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 225/479] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:09 2022] GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:09.857702 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-76b5937c-8d40-43f1-8427-54429f2558a6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:09.858351 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-76b5937c-8d40-43f1-8427-54429f2558a6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:09.864351 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-76b5937c-8d40-43f1-8427-54429f2558a6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:09.864800 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-76b5937c-8d40-43f1-8427-54429f2558a6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:09.865556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-76b5937c-8d40-43f1-8427-54429f2558a6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:09.866023 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-76b5937c-8d40-43f1-8427-54429f2558a6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:09.995183 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-76b5937c-8d40-43f1-8427-54429f2558a6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:10.002941 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-76b5937c-8d40-43f1-8427-54429f2558a6 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1371 microversion: 2.1 time: 0.149096 Jul 12 17:29:10.003502 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 255/480] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:09 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:10.801693 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-31c81a93-fb47-4209-8e81-d2bb5745ae6b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:10.802323 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-31c81a93-fb47-4209-8e81-d2bb5745ae6b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:10.808680 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-31c81a93-fb47-4209-8e81-d2bb5745ae6b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:10.809120 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-31c81a93-fb47-4209-8e81-d2bb5745ae6b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:10.809903 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-31c81a93-fb47-4209-8e81-d2bb5745ae6b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:10.810336 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-31c81a93-fb47-4209-8e81-d2bb5745ae6b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:10.936150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-31c81a93-fb47-4209-8e81-d2bb5745ae6b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:10.943538 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-31c81a93-fb47-4209-8e81-d2bb5745ae6b tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 200 len: 1313 microversion: 2.1 time: 0.145677 Jul 12 17:29:10.944099 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 226/481] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:10 2022] GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:11.018831 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-367afac3-c423-470d-a8e5-ec526f307c02 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:11.019442 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-367afac3-c423-470d-a8e5-ec526f307c02 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:11.025367 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-367afac3-c423-470d-a8e5-ec526f307c02 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:11.025851 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-367afac3-c423-470d-a8e5-ec526f307c02 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:11.026611 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-367afac3-c423-470d-a8e5-ec526f307c02 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:11.027045 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-367afac3-c423-470d-a8e5-ec526f307c02 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:11.155492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-367afac3-c423-470d-a8e5-ec526f307c02 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:11.162697 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-367afac3-c423-470d-a8e5-ec526f307c02 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1371 microversion: 2.1 time: 0.148251 Jul 12 17:29:11.163262 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 256/482] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:11 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:11.960306 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d59d56f0-8b8d-4e9e-8ee1-d65815eebce6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:11.960914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d59d56f0-8b8d-4e9e-8ee1-d65815eebce6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:11.967398 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d59d56f0-8b8d-4e9e-8ee1-d65815eebce6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:11.967849 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d59d56f0-8b8d-4e9e-8ee1-d65815eebce6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:11.968612 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d59d56f0-8b8d-4e9e-8ee1-d65815eebce6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:11.969049 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d59d56f0-8b8d-4e9e-8ee1-d65815eebce6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:12.093475 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d59d56f0-8b8d-4e9e-8ee1-d65815eebce6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:12.100776 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d59d56f0-8b8d-4e9e-8ee1-d65815eebce6 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 200 len: 1313 microversion: 2.1 time: 0.144344 Jul 12 17:29:12.101340 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 227/483] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:11 2022] GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:12.178259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-083643c2-ccd9-45c9-bc71-45167aff372a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:12.178871 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-083643c2-ccd9-45c9-bc71-45167aff372a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:12.185012 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-083643c2-ccd9-45c9-bc71-45167aff372a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:12.185492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-083643c2-ccd9-45c9-bc71-45167aff372a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:12.186777 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-083643c2-ccd9-45c9-bc71-45167aff372a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:12.187211 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-083643c2-ccd9-45c9-bc71-45167aff372a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:12.321705 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-083643c2-ccd9-45c9-bc71-45167aff372a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:12.329509 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-083643c2-ccd9-45c9-bc71-45167aff372a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1371 microversion: 2.1 time: 0.155082 Jul 12 17:29:12.330099 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 257/484] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:12 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:12.409087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-99b1d552-7aeb-431b-93c5-7211c23c3b64 req-f56557b7-d0fa-4759-91aa-a7a01a703a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eedcd296-5cc8-496c-9285-6a6d001811e6", "name": "network-vif-plugged", "status": "completed", "tag": "c315ba00-73a2-4638-a32f-23677b161d7d"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:29:12.418725 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-99b1d552-7aeb-431b-93c5-7211c23c3b64 req-f56557b7-d0fa-4759-91aa-a7a01a703a9a service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:12.419249 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-99b1d552-7aeb-431b-93c5-7211c23c3b64 req-f56557b7-d0fa-4759-91aa-a7a01a703a9a service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:12.431177 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-99b1d552-7aeb-431b-93c5-7211c23c3b64 req-f56557b7-d0fa-4759-91aa-a7a01a703a9a service nova] Creating event network-vif-plugged:c315ba00-73a2-4638-a32f-23677b161d7d for instance eedcd296-5cc8-496c-9285-6a6d001811e6 on hv-cinder-84932 Jul 12 17:29:12.436706 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-99b1d552-7aeb-431b-93c5-7211c23c3b64 req-f56557b7-d0fa-4759-91aa-a7a01a703a9a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030911 Jul 12 17:29:12.437445 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 228/485] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:29:13.117413 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-da896404-d3c6-43ac-a23d-7b27386b5ef0 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:13.118052 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-da896404-d3c6-43ac-a23d-7b27386b5ef0 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:13.123909 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-da896404-d3c6-43ac-a23d-7b27386b5ef0 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:13.124348 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-da896404-d3c6-43ac-a23d-7b27386b5ef0 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:13.125095 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-da896404-d3c6-43ac-a23d-7b27386b5ef0 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:13.125522 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-da896404-d3c6-43ac-a23d-7b27386b5ef0 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:13.251378 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-da896404-d3c6-43ac-a23d-7b27386b5ef0 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:13.258624 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-da896404-d3c6-43ac-a23d-7b27386b5ef0 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 200 len: 1313 microversion: 2.1 time: 0.145180 Jul 12 17:29:13.259178 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 258/486] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:13 2022] GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:13.347135 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f5969e2b-6165-4fc3-aa3f-e30f839fa9b0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:13.347879 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f5969e2b-6165-4fc3-aa3f-e30f839fa9b0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:13.354525 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f5969e2b-6165-4fc3-aa3f-e30f839fa9b0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:13.354987 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f5969e2b-6165-4fc3-aa3f-e30f839fa9b0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:13.355766 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f5969e2b-6165-4fc3-aa3f-e30f839fa9b0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:13.356210 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f5969e2b-6165-4fc3-aa3f-e30f839fa9b0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:13.484948 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f5969e2b-6165-4fc3-aa3f-e30f839fa9b0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:13.492395 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f5969e2b-6165-4fc3-aa3f-e30f839fa9b0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1371 microversion: 2.1 time: 0.150012 Jul 12 17:29:13.492965 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 229/487] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:13 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:14.277015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-13ce4767-87ba-4983-acec-8d5850db302d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:14.278028 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-13ce4767-87ba-4983-acec-8d5850db302d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:14.284389 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13ce4767-87ba-4983-acec-8d5850db302d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:14.284841 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13ce4767-87ba-4983-acec-8d5850db302d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:14.285622 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13ce4767-87ba-4983-acec-8d5850db302d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:14.286064 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13ce4767-87ba-4983-acec-8d5850db302d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:14.509813 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9af74caf-f529-4fd3-8fec-57c4d8fe6fb2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:14.510414 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9af74caf-f529-4fd3-8fec-57c4d8fe6fb2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:14.518135 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9af74caf-f529-4fd3-8fec-57c4d8fe6fb2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:14.518628 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9af74caf-f529-4fd3-8fec-57c4d8fe6fb2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:14.519477 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9af74caf-f529-4fd3-8fec-57c4d8fe6fb2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:14.519971 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9af74caf-f529-4fd3-8fec-57c4d8fe6fb2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:14.573184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-13ce4767-87ba-4983-acec-8d5850db302d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:14.580460 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-13ce4767-87ba-4983-acec-8d5850db302d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 200 len: 1313 microversion: 2.1 time: 0.308482 Jul 12 17:29:14.581240 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 259/488] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:14 2022] GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:14.795193 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9af74caf-f529-4fd3-8fec-57c4d8fe6fb2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:14.803161 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9af74caf-f529-4fd3-8fec-57c4d8fe6fb2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1371 microversion: 2.1 time: 0.297219 Jul 12 17:29:14.803727 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 230/489] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:14 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1371 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:29:15.654794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f02e2a76-ec0b-4877-852b-16c7305f34e8 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:15.655763 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f02e2a76-ec0b-4877-852b-16c7305f34e8 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:15.674192 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f02e2a76-ec0b-4877-852b-16c7305f34e8 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:15.674707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f02e2a76-ec0b-4877-852b-16c7305f34e8 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:15.675618 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f02e2a76-ec0b-4877-852b-16c7305f34e8 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:15.676258 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f02e2a76-ec0b-4877-852b-16c7305f34e8 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:15.681618 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:15.818220 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f02e2a76-ec0b-4877-852b-16c7305f34e8 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:15.820909 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1ef4a228-e777-4c78-96f9-5a7c3fa702f4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:15.822230 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1ef4a228-e777-4c78-96f9-5a7c3fa702f4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:15.831813 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1ef4a228-e777-4c78-96f9-5a7c3fa702f4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:15.832496 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1ef4a228-e777-4c78-96f9-5a7c3fa702f4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:15.833535 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1ef4a228-e777-4c78-96f9-5a7c3fa702f4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:15.834211 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1ef4a228-e777-4c78-96f9-5a7c3fa702f4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:15.834888 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f02e2a76-ec0b-4877-852b-16c7305f34e8 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 200 len: 1497 microversion: 2.1 time: 0.181271 Jul 12 17:29:15.836217 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 260/490] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:15 2022] GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:16.021885 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1ef4a228-e777-4c78-96f9-5a7c3fa702f4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:16.029336 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1ef4a228-e777-4c78-96f9-5a7c3fa702f4 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1371 microversion: 2.1 time: 0.212739 Jul 12 17:29:16.030008 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 231/491] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:15 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:29:16.609603 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-47d46773-f889-46b4-867f-efc3422649d5 req-991906b4-ae44-4a71-bb61-9f8722cd0fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5af452-8518-42e8-b587-1d1fe57554c9", "name": "network-vif-plugged", "status": "completed", "tag": "b3ccbfc5-0e69-441b-9bcc-1d315b0bf93c"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:29:16.617441 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-47d46773-f889-46b4-867f-efc3422649d5 req-991906b4-ae44-4a71-bb61-9f8722cd0fed service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:16.617926 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-47d46773-f889-46b4-867f-efc3422649d5 req-991906b4-ae44-4a71-bb61-9f8722cd0fed service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:16.629807 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-47d46773-f889-46b4-867f-efc3422649d5 req-991906b4-ae44-4a71-bb61-9f8722cd0fed service nova] Creating event network-vif-plugged:b3ccbfc5-0e69-441b-9bcc-1d315b0bf93c for instance 0e5af452-8518-42e8-b587-1d1fe57554c9 on hv-cinder-84932 Jul 12 17:29:16.634644 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-47d46773-f889-46b4-867f-efc3422649d5 req-991906b4-ae44-4a71-bb61-9f8722cd0fed service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029309 Jul 12 17:29:16.635604 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 261/492] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:29:17.046212 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7fc4b7e4-336c-4f7f-ac32-c2d790f70379 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:17.046940 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7fc4b7e4-336c-4f7f-ac32-c2d790f70379 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:17.053769 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7fc4b7e4-336c-4f7f-ac32-c2d790f70379 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:17.054225 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7fc4b7e4-336c-4f7f-ac32-c2d790f70379 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:17.054985 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7fc4b7e4-336c-4f7f-ac32-c2d790f70379 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:17.055601 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7fc4b7e4-336c-4f7f-ac32-c2d790f70379 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:17.125025 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c0662b5b-ef22-4417-9e10-f19c8c68f496 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:17.125607 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c0662b5b-ef22-4417-9e10-f19c8c68f496 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:17.133370 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c0662b5b-ef22-4417-9e10-f19c8c68f496 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:17.134111 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c0662b5b-ef22-4417-9e10-f19c8c68f496 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:17.135081 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c0662b5b-ef22-4417-9e10-f19c8c68f496 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:17.135695 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c0662b5b-ef22-4417-9e10-f19c8c68f496 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:17.166820 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c0662b5b-ef22-4417-9e10-f19c8c68f496 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:29:17.196473 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7fc4b7e4-336c-4f7f-ac32-c2d790f70379 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:17.204441 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7fc4b7e4-336c-4f7f-ac32-c2d790f70379 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1371 microversion: 2.1 time: 0.162118 Jul 12 17:29:17.205107 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 232/493] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:17 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:17.247898 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c0662b5b-ef22-4417-9e10-f19c8c68f496 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "DELETE /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 204 len: 0 microversion: 2.1 time: 0.127262 Jul 12 17:29:17.251979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 262/494] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:29:17 2022] DELETE /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 17:29:17.257455 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-109cf68b-80ac-4a55-9f33-83825f7e2d08 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:17.258128 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-109cf68b-80ac-4a55-9f33-83825f7e2d08 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:17.264843 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-109cf68b-80ac-4a55-9f33-83825f7e2d08 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:17.265307 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-109cf68b-80ac-4a55-9f33-83825f7e2d08 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:17.266191 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-109cf68b-80ac-4a55-9f33-83825f7e2d08 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:17.266623 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-109cf68b-80ac-4a55-9f33-83825f7e2d08 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:17.393873 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-109cf68b-80ac-4a55-9f33-83825f7e2d08 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:17.401345 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-109cf68b-80ac-4a55-9f33-83825f7e2d08 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 200 len: 1503 microversion: 2.1 time: 0.148172 Jul 12 17:29:17.401929 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 233/495] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:17 2022] GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:18.221163 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-68f8a3fa-d1f2-441a-ad07-fc8df4ac210a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:18.221879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-68f8a3fa-d1f2-441a-ad07-fc8df4ac210a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:18.227731 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68f8a3fa-d1f2-441a-ad07-fc8df4ac210a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:18.228173 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68f8a3fa-d1f2-441a-ad07-fc8df4ac210a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:18.228928 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68f8a3fa-d1f2-441a-ad07-fc8df4ac210a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:18.229357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68f8a3fa-d1f2-441a-ad07-fc8df4ac210a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:18.362206 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-68f8a3fa-d1f2-441a-ad07-fc8df4ac210a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:18.369513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-68f8a3fa-d1f2-441a-ad07-fc8df4ac210a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1371 microversion: 2.1 time: 0.153066 Jul 12 17:29:18.370113 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 263/496] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:18 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:18.418250 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-002888f1-ccea-4389-8fae-ab9be26d666d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:18.418895 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-002888f1-ccea-4389-8fae-ab9be26d666d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:18.425258 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-002888f1-ccea-4389-8fae-ab9be26d666d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:18.425737 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-002888f1-ccea-4389-8fae-ab9be26d666d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:18.426500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-002888f1-ccea-4389-8fae-ab9be26d666d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:18.426944 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-002888f1-ccea-4389-8fae-ab9be26d666d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:18.555055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-002888f1-ccea-4389-8fae-ab9be26d666d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:18.562312 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-002888f1-ccea-4389-8fae-ab9be26d666d tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 200 len: 1503 microversion: 2.1 time: 0.147930 Jul 12 17:29:18.562871 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 234/497] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:18 2022] GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:19.387219 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-db7c1b83-60a6-443b-a8ce-fb508efd624d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:19.387832 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-db7c1b83-60a6-443b-a8ce-fb508efd624d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:19.401567 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db7c1b83-60a6-443b-a8ce-fb508efd624d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:19.401567 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db7c1b83-60a6-443b-a8ce-fb508efd624d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:19.401567 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db7c1b83-60a6-443b-a8ce-fb508efd624d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:19.401567 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db7c1b83-60a6-443b-a8ce-fb508efd624d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:19.534223 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-db7c1b83-60a6-443b-a8ce-fb508efd624d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:19.541504 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-db7c1b83-60a6-443b-a8ce-fb508efd624d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1371 microversion: 2.1 time: 0.158893 Jul 12 17:29:19.542099 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 264/498] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:19 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:19.579344 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-680d2444-94be-46f3-b44a-ccccc2108e69 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:19.579886 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-680d2444-94be-46f3-b44a-ccccc2108e69 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:19.586265 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-680d2444-94be-46f3-b44a-ccccc2108e69 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:19.586712 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-680d2444-94be-46f3-b44a-ccccc2108e69 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:19.587471 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-680d2444-94be-46f3-b44a-ccccc2108e69 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:19.587903 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-680d2444-94be-46f3-b44a-ccccc2108e69 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:19.714620 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-680d2444-94be-46f3-b44a-ccccc2108e69 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:19.723016 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-680d2444-94be-46f3-b44a-ccccc2108e69 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 200 len: 1503 microversion: 2.1 time: 0.147489 Jul 12 17:29:19.723562 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 235/499] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:19 2022] GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:20.430606 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-dd25a848-43d2-47da-b2c3-803e03cd0e65 req-dff766d0-1151-4936-bdce-a4b5d2cf8daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eedcd296-5cc8-496c-9285-6a6d001811e6", "name": "network-vif-deleted", "tag": "c315ba00-73a2-4638-a32f-23677b161d7d"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:29:20.439153 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-dd25a848-43d2-47da-b2c3-803e03cd0e65 req-dff766d0-1151-4936-bdce-a4b5d2cf8daa service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:20.439595 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-dd25a848-43d2-47da-b2c3-803e03cd0e65 req-dff766d0-1151-4936-bdce-a4b5d2cf8daa service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:20.450711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-dd25a848-43d2-47da-b2c3-803e03cd0e65 req-dff766d0-1151-4936-bdce-a4b5d2cf8daa service nova] Creating event network-vif-deleted:c315ba00-73a2-4638-a32f-23677b161d7d for instance eedcd296-5cc8-496c-9285-6a6d001811e6 on hv-cinder-84932 Jul 12 17:29:20.456483 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-dd25a848-43d2-47da-b2c3-803e03cd0e65 req-dff766d0-1151-4936-bdce-a4b5d2cf8daa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029493 Jul 12 17:29:20.457580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 265/500] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:29:20.558484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f7e6d1fc-a95a-4308-8ff3-866d416ebaaf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:20.559256 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f7e6d1fc-a95a-4308-8ff3-866d416ebaaf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:20.565798 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f7e6d1fc-a95a-4308-8ff3-866d416ebaaf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:20.566237 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f7e6d1fc-a95a-4308-8ff3-866d416ebaaf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:20.567053 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f7e6d1fc-a95a-4308-8ff3-866d416ebaaf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:20.567464 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f7e6d1fc-a95a-4308-8ff3-866d416ebaaf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:20.704432 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f7e6d1fc-a95a-4308-8ff3-866d416ebaaf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:20.711939 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f7e6d1fc-a95a-4308-8ff3-866d416ebaaf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1565 microversion: 2.1 time: 0.157197 Jul 12 17:29:20.712569 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 236/501] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:20 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:20.728636 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6688bfde-4d58-4381-aca1-403cc00bb5d9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:20.729095 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6688bfde-4d58-4381-aca1-403cc00bb5d9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:20.737029 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6688bfde-4d58-4381-aca1-403cc00bb5d9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:20.737858 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6688bfde-4d58-4381-aca1-403cc00bb5d9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:20.739081 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6688bfde-4d58-4381-aca1-403cc00bb5d9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:20.739524 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6688bfde-4d58-4381-aca1-403cc00bb5d9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:20.739997 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6513cb58-3121-4611-8907-3922a922f494 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:20.740638 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6513cb58-3121-4611-8907-3922a922f494 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:20.746779 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6513cb58-3121-4611-8907-3922a922f494 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:20.747222 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6513cb58-3121-4611-8907-3922a922f494 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:20.749015 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6513cb58-3121-4611-8907-3922a922f494 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:20.749763 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6513cb58-3121-4611-8907-3922a922f494 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:20.754112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:20.836723 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6513cb58-3121-4611-8907-3922a922f494 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be175ae71d25489c82ab8e558a93e003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d32278a254e65ae2ac38b2c7a8e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:20.844607 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6513cb58-3121-4611-8907-3922a922f494 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 200 len: 1461 microversion: 2.1 time: 0.108546 Jul 12 17:29:20.851390 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6688bfde-4d58-4381-aca1-403cc00bb5d9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.127081 Jul 12 17:29:20.852180 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 266/502] 10.222.0.62 () {58 vars in 1274 bytes} [Tue Jul 12 17:29:20 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:29:20.854769 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 237/503] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:20 2022] GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 1461 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:29:21.861874 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f9072dac-f7d5-4ead-9ffc-37369ed302f3 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:21.862476 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f9072dac-f7d5-4ead-9ffc-37369ed302f3 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] [instance: eedcd296-5cc8-496c-9285-6a6d001811e6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:21.868531 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f9072dac-f7d5-4ead-9ffc-37369ed302f3 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:21.869001 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f9072dac-f7d5-4ead-9ffc-37369ed302f3 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:21.869790 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f9072dac-f7d5-4ead-9ffc-37369ed302f3 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:21.870227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f9072dac-f7d5-4ead-9ffc-37369ed302f3 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:21.884026 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-f9072dac-f7d5-4ead-9ffc-37369ed302f3 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] HTTP exception thrown: Instance eedcd296-5cc8-496c-9285-6a6d001811e6 could not be found. Jul 12 17:29:21.888704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f9072dac-f7d5-4ead-9ffc-37369ed302f3 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Request method failure captured: Jul 12 17:29:21.888704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 HTTP/1.1 Jul 12 17:29:21.888704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:29:21.888704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:29:21.888704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:29:21.888704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:29:21.888704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:29:21.888704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:29:21.888704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:29:21.888704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:29:21.888704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza8nFOeQcQYME00sSq_36UGg0oN82oxTmJmlLH7BKSqXnZ1FJ3CGO4Ln8_unLQhZwZPSicBS652YI_wnfFxmT2IVZIyyWpKZfZUJaSlxS0BollBkd884DLDV2ivQCp3nuNjZYejMFQCOmAV4XfwPKP8HzCD6SX1dTlUOOtTKtfd4LU8 Jul 12 17:29:21.888704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:29:21.888704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:29:21.888704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:29:21.888704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:29:21.888704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:29:21.888704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:29:21.888704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: fb0d32278a254e65ae2ac38b2c7a8e48 Jul 12 17:29:21.888704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesActionsTest-775230559 Jul 12 17:29:21.888704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:29:21.888704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:29:21.890786 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fb0d32278a254e65ae2ac38b2c7a8e48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fb0d32278a254e65ae2ac38b2c7a8e48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fb0d32278a254e65ae2ac38b2c7a8e48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fb0d32278a254e65ae2ac38b2c7a8e48", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:29:21.890786 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesActionsTest-775230559 Jul 12 17:29:21.890786 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: fb0d32278a254e65ae2ac38b2c7a8e48 Jul 12 17:29:21.890786 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesActionsTest-775230559 Jul 12 17:29:21.890786 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesActionsTest-775230559-project Jul 12 17:29:21.890786 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:29:21.890786 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:29:21.890786 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: be175ae71d25489c82ab8e558a93e003 Jul 12 17:29:21.890786 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesActionsTest-775230559-project Jul 12 17:29:21.890786 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:29:21.890786 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Instance eedcd296-5cc8-496c-9285-6a6d001811e6 could not be found. Jul 12 17:29:21.890786 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': 'eedcd296-5cc8-496c-9285-6a6d001811e6'} Jul 12 17:29:21.891533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:29:21.891533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:29:21.891533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:29:21.891533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:29:21.891533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:29:21.891533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:29:21.891533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:29:21.891533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:29:21.891533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:29:21.891533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:29:21.891533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eedcd296-5cc8-496c-9285-6a6d001811e6 could not be found. Jul 12 17:29:21.891533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:29:21.891533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:29:21.891533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:29:21.891533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:29:21.891533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:29:21.891533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:29:21.891533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:29:21.891533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:29:21.891533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:29:21.892743 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:29:21.892743 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:29:21.892743 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:29:21.892743 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:29:21.892743 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:29:21.892743 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:29:21.892743 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:29:21.892743 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eedcd296-5cc8-496c-9285-6a6d001811e6 could not be found. Jul 12 17:29:21.892743 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:29:21.892743 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:29:21.892743 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:29:21.892743 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:29:21.892743 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:29:21.892743 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:29:21.892743 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:29:21.892743 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:29:21.892743 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eedcd296-5cc8-496c-9285-6a6d001811e6 could not be found. Jul 12 17:29:21.892743 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:29:21.893861 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f9072dac-f7d5-4ead-9ffc-37369ed302f3 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] Returning 404 to user: Instance eedcd296-5cc8-496c-9285-6a6d001811e6 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:29:21.893861 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f9072dac-f7d5-4ead-9ffc-37369ed302f3 tempest-VolumesActionsTest-775230559 tempest-VolumesActionsTest-775230559-project] 10.222.0.62 "GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6" status: 404 len: 111 microversion: 2.1 time: 0.032639 Jul 12 17:29:21.893861 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 267/504] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:21 2022] GET /compute/v2.1/servers/eedcd296-5cc8-496c-9285-6a6d001811e6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:29:22.473076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-2797f2ae-bcb3-4ea7-8860-5f76d4a88d30 req-e956bc81-3167-4a08-9a2f-2f66be3feb8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e5af452-8518-42e8-b587-1d1fe57554c9", "tag": "b3ccbfc5-0e69-441b-9bcc-1d315b0bf93c"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:29:22.482218 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-2797f2ae-bcb3-4ea7-8860-5f76d4a88d30 req-e956bc81-3167-4a08-9a2f-2f66be3feb8d service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:22.483226 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-2797f2ae-bcb3-4ea7-8860-5f76d4a88d30 req-e956bc81-3167-4a08-9a2f-2f66be3feb8d service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:22.495579 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-2797f2ae-bcb3-4ea7-8860-5f76d4a88d30 req-e956bc81-3167-4a08-9a2f-2f66be3feb8d service nova] Creating event network-changed:b3ccbfc5-0e69-441b-9bcc-1d315b0bf93c for instance 0e5af452-8518-42e8-b587-1d1fe57554c9 on hv-cinder-84932 Jul 12 17:29:22.500853 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-2797f2ae-bcb3-4ea7-8860-5f76d4a88d30 req-e956bc81-3167-4a08-9a2f-2f66be3feb8d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031490 Jul 12 17:29:22.502072 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 238/505] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:29:25.328795 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d39f2d61-e418-4e86-8bf6-014950f619ac tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:25.329275 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d39f2d61-e418-4e86-8bf6-014950f619ac tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:25.335822 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d39f2d61-e418-4e86-8bf6-014950f619ac tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:25.336297 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d39f2d61-e418-4e86-8bf6-014950f619ac tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:25.337052 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d39f2d61-e418-4e86-8bf6-014950f619ac tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:25.337484 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d39f2d61-e418-4e86-8bf6-014950f619ac tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:25.360547 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d39f2d61-e418-4e86-8bf6-014950f619ac tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2/ips" status: 200 len: 150 microversion: 2.1 time: 0.035779 Jul 12 17:29:25.361093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 268/506] 10.222.0.62 () {58 vars in 1247 bytes} [Tue Jul 12 17:29:25 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:29:28.828352 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6af8c84b-d528-4b84-9cb9-93d4c253a10e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d00ca24-3258-42fe-89c2-f8bca45db332"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:29:28.830363 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6af8c84b-d528-4b84-9cb9-93d4c253a10e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:28.837789 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6af8c84b-d528-4b84-9cb9-93d4c253a10e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:28.838225 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6af8c84b-d528-4b84-9cb9-93d4c253a10e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:28.839037 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6af8c84b-d528-4b84-9cb9-93d4c253a10e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:28.839482 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6af8c84b-d528-4b84-9cb9-93d4c253a10e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:29.134916 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6af8c84b-d528-4b84-9cb9-93d4c253a10e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "POST /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311334 Jul 12 17:29:29.135993 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 239/507] 10.222.0.62 () {60 vars in 1322 bytes} [Tue Jul 12 17:29:28 2022] POST /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:29:36.721607 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e649802b-6648-46c8-b59a-8d08fa7db0f3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Action: 'create', calling method: .version_select at 0x7f8729a21c10>, body: {"keypair": {"name": "tempest-keypair-1447348453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjDg+6OdePZdlmzF7LRFZmqvPKB24FyzSkrNeQpi9osDxlkEg01UHaOSsc2m2EFVAf/QJmc+GPP7nv5D5k4+4kuqVlBK9/1J2meGnTxoeQ3IgNWQ/RRr544d9ys7/iQBw=="}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:29:36.725845 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:36.726532 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:36.750379 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-e649802b-6648-46c8-b59a-8d08fa7db0f3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Getting quotas for project 4a4e837b171b4b4a9c2ad230cda53452. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:29:36.763330 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-e649802b-6648-46c8-b59a-8d08fa7db0f3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Getting quotas for user 38a74ebdd59a491386aedcdbd312b363 and project 4a4e837b171b4b4a9c2ad230cda53452. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:29:36.804245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e649802b-6648-46c8-b59a-8d08fa7db0f3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.086620 Jul 12 17:29:36.809877 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 269/508] 10.222.0.62 () {60 vars in 1158 bytes} [Tue Jul 12 17:29:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:29:38.331539 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-116bb261-1a88-4768-8d03-54410967fccd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1827228444", "imageRef": "b19e7830-75c9-4706-bd34-4954ba6b4cc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3be9cb9-0ea5-4d05-b64b-1defd294a562"}], "security_groups": [{"name": "tempest-securitygroup--1815011138"}], "key_name": "tempest-keypair-1447348453", "user_data": "}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:29:38.338287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=54 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:38.445668 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.network.neutron [None req-116bb261-1a88-4768-8d03-54410967fccd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] validate_networks() for [('e3be9cb9-0ea5-4d05-b64b-1defd294a562', None, None, None, None, None)] {{(pid=117939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:29:38.894821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-116bb261-1a88-4768-8d03-54410967fccd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Flavor limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:29:38.895460 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-116bb261-1a88-4768-8d03-54410967fccd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Image limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:29:38.896139 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-116bb261-1a88-4768-8d03-54410967fccd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Flavor pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:29:38.896722 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-116bb261-1a88-4768-8d03-54410967fccd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Image pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:29:38.897164 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-116bb261-1a88-4768-8d03-54410967fccd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:29:38.907404 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-116bb261-1a88-4768-8d03-54410967fccd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:38.908079 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-116bb261-1a88-4768-8d03-54410967fccd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:38.909062 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-116bb261-1a88-4768-8d03-54410967fccd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:38.909499 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-116bb261-1a88-4768-8d03-54410967fccd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:38.928243 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-116bb261-1a88-4768-8d03-54410967fccd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Getting quotas for project 4a4e837b171b4b4a9c2ad230cda53452. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:29:38.932631 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-116bb261-1a88-4768-8d03-54410967fccd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Getting quotas for user 38a74ebdd59a491386aedcdbd312b363 and project 4a4e837b171b4b4a9c2ad230cda53452. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:29:38.944224 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-116bb261-1a88-4768-8d03-54410967fccd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Going to run 1 instances... {{(pid=117939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:29:38.946895 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-116bb261-1a88-4768-8d03-54410967fccd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19e7830-75c9-4706-bd34-4954ba6b4cc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:29:39.000702 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-116bb261-1a88-4768-8d03-54410967fccd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.674341 Jul 12 17:29:39.006295 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 240/509] 10.222.0.62 () {60 vars in 1146 bytes} [Tue Jul 12 17:29:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:29:39.012811 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8cec0084-39f6-43ef-8022-c5a0105a1d09 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:39.013700 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8cec0084-39f6-43ef-8022-c5a0105a1d09 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:39.087733 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8cec0084-39f6-43ef-8022-c5a0105a1d09 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:39.095868 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8cec0084-39f6-43ef-8022-c5a0105a1d09 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 200 len: 1242 microversion: 2.1 time: 0.088030 Jul 12 17:29:39.097053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 270/510] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:39 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:40.113166 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-31946a2c-cf31-46a1-956d-30c66ce151f4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:40.113793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-31946a2c-cf31-46a1-956d-30c66ce151f4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:40.121956 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-31946a2c-cf31-46a1-956d-30c66ce151f4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:40.122777 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-31946a2c-cf31-46a1-956d-30c66ce151f4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:40.123693 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-31946a2c-cf31-46a1-956d-30c66ce151f4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:40.124838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-31946a2c-cf31-46a1-956d-30c66ce151f4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:40.198150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-31946a2c-cf31-46a1-956d-30c66ce151f4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:40.210867 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-31946a2c-cf31-46a1-956d-30c66ce151f4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 200 len: 1294 microversion: 2.1 time: 0.101115 Jul 12 17:29:40.220573 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 241/511] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:40 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 1294 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:41.231248 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f8c59754-9537-4f12-ac85-2df9564a7b12 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:41.232321 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f8c59754-9537-4f12-ac85-2df9564a7b12 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:41.244264 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f8c59754-9537-4f12-ac85-2df9564a7b12 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:41.244886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f8c59754-9537-4f12-ac85-2df9564a7b12 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:41.246167 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f8c59754-9537-4f12-ac85-2df9564a7b12 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:41.246741 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f8c59754-9537-4f12-ac85-2df9564a7b12 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:41.555310 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f8c59754-9537-4f12-ac85-2df9564a7b12 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:41.563870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f8c59754-9537-4f12-ac85-2df9564a7b12 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 200 len: 1368 microversion: 2.1 time: 0.338897 Jul 12 17:29:41.564787 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 271/512] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:41 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 1368 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:42.349085 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-5cccf92a-b6f9-4c39-abff-f25f391a245b req-d083feed-dd4a-4125-ab7e-c8871ede44c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34d0b582-fd90-42a8-a0cf-9acd222b3d26", "tag": "2a9d6ee1-0082-43be-b42c-fc278ebab767"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:29:42.380658 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-5cccf92a-b6f9-4c39-abff-f25f391a245b req-d083feed-dd4a-4125-ab7e-c8871ede44c4 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:42.380658 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-5cccf92a-b6f9-4c39-abff-f25f391a245b req-d083feed-dd4a-4125-ab7e-c8871ede44c4 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:42.398925 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-5cccf92a-b6f9-4c39-abff-f25f391a245b req-d083feed-dd4a-4125-ab7e-c8871ede44c4 service nova] Creating event network-changed:2a9d6ee1-0082-43be-b42c-fc278ebab767 for instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 on hv-cinder-84932 Jul 12 17:29:42.404022 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-5cccf92a-b6f9-4c39-abff-f25f391a245b req-d083feed-dd4a-4125-ab7e-c8871ede44c4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060115 Jul 12 17:29:42.404617 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 242/513] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:29:42.581481 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a517de71-f377-4816-a13c-2c473cfce2b7 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:42.582119 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a517de71-f377-4816-a13c-2c473cfce2b7 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:42.588352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a517de71-f377-4816-a13c-2c473cfce2b7 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:42.589081 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a517de71-f377-4816-a13c-2c473cfce2b7 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:42.590032 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a517de71-f377-4816-a13c-2c473cfce2b7 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:42.590612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a517de71-f377-4816-a13c-2c473cfce2b7 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:42.843283 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a517de71-f377-4816-a13c-2c473cfce2b7 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:42.853407 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a517de71-f377-4816-a13c-2c473cfce2b7 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 200 len: 1368 microversion: 2.1 time: 0.275790 Jul 12 17:29:42.854867 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 272/514] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:42 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 1368 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:43.870659 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-db24b41f-6c6b-4fd2-b707-1481bcbd23c6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:43.871349 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-db24b41f-6c6b-4fd2-b707-1481bcbd23c6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:43.878412 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-db24b41f-6c6b-4fd2-b707-1481bcbd23c6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:43.878860 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-db24b41f-6c6b-4fd2-b707-1481bcbd23c6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:43.879896 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-db24b41f-6c6b-4fd2-b707-1481bcbd23c6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:43.880401 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-db24b41f-6c6b-4fd2-b707-1481bcbd23c6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:44.009028 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-db24b41f-6c6b-4fd2-b707-1481bcbd23c6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:44.016340 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-db24b41f-6c6b-4fd2-b707-1481bcbd23c6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 200 len: 1368 microversion: 2.1 time: 0.150102 Jul 12 17:29:44.016897 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 243/515] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:43 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:45.032844 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-753cc29a-d90e-4bd8-8c4e-6da03748fc12 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:45.033362 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-753cc29a-d90e-4bd8-8c4e-6da03748fc12 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:45.039271 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-753cc29a-d90e-4bd8-8c4e-6da03748fc12 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:45.039710 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-753cc29a-d90e-4bd8-8c4e-6da03748fc12 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:45.040505 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-753cc29a-d90e-4bd8-8c4e-6da03748fc12 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:45.041011 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-753cc29a-d90e-4bd8-8c4e-6da03748fc12 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:45.168949 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-753cc29a-d90e-4bd8-8c4e-6da03748fc12 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:45.176161 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-753cc29a-d90e-4bd8-8c4e-6da03748fc12 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 200 len: 1368 microversion: 2.1 time: 0.147238 Jul 12 17:29:45.176718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 273/516] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:45 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:46.192480 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b7ccc0cf-05da-4e05-857b-27bb47881dce tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:46.193085 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b7ccc0cf-05da-4e05-857b-27bb47881dce tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:46.200402 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b7ccc0cf-05da-4e05-857b-27bb47881dce tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:46.200918 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b7ccc0cf-05da-4e05-857b-27bb47881dce tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:46.202342 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b7ccc0cf-05da-4e05-857b-27bb47881dce tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:46.202778 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b7ccc0cf-05da-4e05-857b-27bb47881dce tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:46.351563 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b7ccc0cf-05da-4e05-857b-27bb47881dce tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:46.359463 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b7ccc0cf-05da-4e05-857b-27bb47881dce tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 200 len: 1368 microversion: 2.1 time: 0.170933 Jul 12 17:29:46.360042 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 244/517] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:46 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:47.376994 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f905e6db-7729-496f-9f8e-9475a3eaf566 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:47.378178 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f905e6db-7729-496f-9f8e-9475a3eaf566 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:47.384239 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f905e6db-7729-496f-9f8e-9475a3eaf566 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:47.384681 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f905e6db-7729-496f-9f8e-9475a3eaf566 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:47.385431 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f905e6db-7729-496f-9f8e-9475a3eaf566 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:47.385893 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f905e6db-7729-496f-9f8e-9475a3eaf566 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:47.525104 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f905e6db-7729-496f-9f8e-9475a3eaf566 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:47.533191 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f905e6db-7729-496f-9f8e-9475a3eaf566 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 200 len: 1368 microversion: 2.1 time: 0.160446 Jul 12 17:29:47.533772 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 274/518] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:47 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:48.550749 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ae72b017-8f1e-4a1e-8859-4d3cacab997a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:48.551366 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ae72b017-8f1e-4a1e-8859-4d3cacab997a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:48.558003 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ae72b017-8f1e-4a1e-8859-4d3cacab997a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:48.558454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ae72b017-8f1e-4a1e-8859-4d3cacab997a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:48.559216 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ae72b017-8f1e-4a1e-8859-4d3cacab997a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:48.559651 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ae72b017-8f1e-4a1e-8859-4d3cacab997a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:48.691813 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ae72b017-8f1e-4a1e-8859-4d3cacab997a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:48.699740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ae72b017-8f1e-4a1e-8859-4d3cacab997a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 200 len: 1368 microversion: 2.1 time: 0.152834 Jul 12 17:29:48.700426 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 245/519] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:48 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:49.186238 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-4321d0d6-3950-417a-9e96-db55430c6b00 req-4875a4a1-f3b7-4d06-b8e0-a7e2f122ffd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d0b582-fd90-42a8-a0cf-9acd222b3d26", "name": "network-vif-plugged", "status": "completed", "tag": "2a9d6ee1-0082-43be-b42c-fc278ebab767"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:29:49.189956 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:49.195945 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-4321d0d6-3950-417a-9e96-db55430c6b00 req-4875a4a1-f3b7-4d06-b8e0-a7e2f122ffd5 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:49.196392 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-4321d0d6-3950-417a-9e96-db55430c6b00 req-4875a4a1-f3b7-4d06-b8e0-a7e2f122ffd5 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:49.208583 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-4321d0d6-3950-417a-9e96-db55430c6b00 req-4875a4a1-f3b7-4d06-b8e0-a7e2f122ffd5 service nova] Creating event network-vif-plugged:2a9d6ee1-0082-43be-b42c-fc278ebab767 for instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 on hv-cinder-84932 Jul 12 17:29:49.213772 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-4321d0d6-3950-417a-9e96-db55430c6b00 req-4875a4a1-f3b7-4d06-b8e0-a7e2f122ffd5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031465 Jul 12 17:29:49.214360 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 275/520] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:29:49.717435 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a7fa68ee-cf10-4913-b815-d2cc9170eb73 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:49.718084 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a7fa68ee-cf10-4913-b815-d2cc9170eb73 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:49.720029 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:49.720679 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=6 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:49.727251 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a7fa68ee-cf10-4913-b815-d2cc9170eb73 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:49.727701 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a7fa68ee-cf10-4913-b815-d2cc9170eb73 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:49.728463 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a7fa68ee-cf10-4913-b815-d2cc9170eb73 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:49.728898 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a7fa68ee-cf10-4913-b815-d2cc9170eb73 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:49.857288 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a7fa68ee-cf10-4913-b815-d2cc9170eb73 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:49.865048 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a7fa68ee-cf10-4913-b815-d2cc9170eb73 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 200 len: 1368 microversion: 2.1 time: 0.151596 Jul 12 17:29:49.865606 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 246/521] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:49 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:50.882715 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0a2ba41e-3760-4559-a334-d4b2aa3fd5b4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:50.883411 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0a2ba41e-3760-4559-a334-d4b2aa3fd5b4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:50.890145 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0a2ba41e-3760-4559-a334-d4b2aa3fd5b4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:50.890586 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0a2ba41e-3760-4559-a334-d4b2aa3fd5b4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:50.891343 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0a2ba41e-3760-4559-a334-d4b2aa3fd5b4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:50.891796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0a2ba41e-3760-4559-a334-d4b2aa3fd5b4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:51.023627 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0a2ba41e-3760-4559-a334-d4b2aa3fd5b4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:51.032047 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0a2ba41e-3760-4559-a334-d4b2aa3fd5b4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 200 len: 1368 microversion: 2.1 time: 0.153465 Jul 12 17:29:51.032609 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 276/522] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:50 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:52.049528 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8020ce39-6f7f-4a66-a68e-753ae73632d4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:52.050313 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8020ce39-6f7f-4a66-a68e-753ae73632d4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:52.057636 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8020ce39-6f7f-4a66-a68e-753ae73632d4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:52.058111 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8020ce39-6f7f-4a66-a68e-753ae73632d4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:52.058900 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8020ce39-6f7f-4a66-a68e-753ae73632d4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:52.059354 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8020ce39-6f7f-4a66-a68e-753ae73632d4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:52.063611 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:52.224384 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8020ce39-6f7f-4a66-a68e-753ae73632d4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:29:52.233607 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8020ce39-6f7f-4a66-a68e-753ae73632d4 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 200 len: 1559 microversion: 2.1 time: 0.188047 Jul 12 17:29:52.234938 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 247/523] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:29:52 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:29:52.250693 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-63e2ffb6-bac0-4dd8-8acc-6593e4303f60 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:29:52.251244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-63e2ffb6-bac0-4dd8-8acc-6593e4303f60 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:29:52.257380 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-63e2ffb6-bac0-4dd8-8acc-6593e4303f60 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:52.257856 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-63e2ffb6-bac0-4dd8-8acc-6593e4303f60 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:52.258600 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-63e2ffb6-bac0-4dd8-8acc-6593e4303f60 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:52.259030 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-63e2ffb6-bac0-4dd8-8acc-6593e4303f60 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:52.342008 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-63e2ffb6-bac0-4dd8-8acc-6593e4303f60 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095204 Jul 12 17:29:52.343329 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 277/524] 10.222.0.62 () {58 vars in 1274 bytes} [Tue Jul 12 17:29:52 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:29:53.360183 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-7a4ace28-596e-4516-88a0-6597355ffc90 req-c8cea949-6006-4300-b495-762ce4916e0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34d0b582-fd90-42a8-a0cf-9acd222b3d26", "tag": "2a9d6ee1-0082-43be-b42c-fc278ebab767"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:29:53.369996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-7a4ace28-596e-4516-88a0-6597355ffc90 req-c8cea949-6006-4300-b495-762ce4916e0a service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:29:53.370662 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-7a4ace28-596e-4516-88a0-6597355ffc90 req-c8cea949-6006-4300-b495-762ce4916e0a service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:29:53.384105 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-7a4ace28-596e-4516-88a0-6597355ffc90 req-c8cea949-6006-4300-b495-762ce4916e0a service nova] Creating event network-changed:2a9d6ee1-0082-43be-b42c-fc278ebab767 for instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 on hv-cinder-84932 Jul 12 17:29:53.390238 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-7a4ace28-596e-4516-88a0-6597355ffc90 req-c8cea949-6006-4300-b495-762ce4916e0a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033434 Jul 12 17:29:53.390966 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 248/525] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:30:01.163770 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b2fc9ad5-e3f6-4d06-a0e2-dbc45819df48 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Action: 'create', calling method: .version_select at 0x7f8729a21550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1098037494", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsyyxs/RJGEvrtVnff75dCSQtyMjVD64BKCaGPL0obHr0xnpl6ixLfYs/JWDUj9qjeeevqF/8peF9dZ/yI0irPgcJp2CSNV762+yooGT9zujBamfiTTajKnBFF/IX9Vyw=="}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:30:01.200628 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-b2fc9ad5-e3f6-4d06-a0e2-dbc45819df48 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Getting quotas for project 471e1e958b29427eb024616ca403985f. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:30:01.205185 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-b2fc9ad5-e3f6-4d06-a0e2-dbc45819df48 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Getting quotas for user 4e066a1d960f48d2ad78d13fc723f54e and project 471e1e958b29427eb024616ca403985f. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:30:01.233015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b2fc9ad5-e3f6-4d06-a0e2-dbc45819df48 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.267009 Jul 12 17:30:01.233630 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 278/526] 10.222.0.62 () {60 vars in 1158 bytes} [Tue Jul 12 17:30:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:30:25.933260 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0e7d7321-b93c-4c3c-8682-3f1b439feaa1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1294874987", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1098037494", "security_groups": [{"name": "tempest-secgroup-smoke-538136482"}], "block_device_mapping_v2": [{"uuid": "0ebdbe5e-fa1a-40ea-ae3b-4bedbd4a43f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "669116b9-7a59-4591-9422-ba3889789c63"}]}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:30:25.941882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:30:25.942536 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=7 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:30:26.045429 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.network.neutron [None req-0e7d7321-b93c-4c3c-8682-3f1b439feaa1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] validate_networks() for [('669116b9-7a59-4591-9422-ba3889789c63', None, None, None, None, None)] {{(pid=117939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:30:26.402239 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-0e7d7321-b93c-4c3c-8682-3f1b439feaa1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Flavor limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:30:26.402663 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-0e7d7321-b93c-4c3c-8682-3f1b439feaa1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Image limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:30:26.403144 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-0e7d7321-b93c-4c3c-8682-3f1b439feaa1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Flavor pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:30:26.403551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-0e7d7321-b93c-4c3c-8682-3f1b439feaa1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Image pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:30:26.403964 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-0e7d7321-b93c-4c3c-8682-3f1b439feaa1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:30:26.412700 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0e7d7321-b93c-4c3c-8682-3f1b439feaa1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:26.413155 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0e7d7321-b93c-4c3c-8682-3f1b439feaa1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:26.413986 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0e7d7321-b93c-4c3c-8682-3f1b439feaa1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:26.414429 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0e7d7321-b93c-4c3c-8682-3f1b439feaa1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:26.431125 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-0e7d7321-b93c-4c3c-8682-3f1b439feaa1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Getting quotas for project 471e1e958b29427eb024616ca403985f. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:30:26.435054 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-0e7d7321-b93c-4c3c-8682-3f1b439feaa1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Getting quotas for user 4e066a1d960f48d2ad78d13fc723f54e and project 471e1e958b29427eb024616ca403985f. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:30:26.490681 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0e7d7321-b93c-4c3c-8682-3f1b439feaa1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Going to run 1 instances... {{(pid=117939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:30:26.492869 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0e7d7321-b93c-4c3c-8682-3f1b439feaa1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ebdbe5e-fa1a-40ea-ae3b-4bedbd4a43f7',volume_size=None,volume_type=None)] {{(pid=117939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:30:26.619693 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0e7d7321-b93c-4c3c-8682-3f1b439feaa1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.690583 Jul 12 17:30:26.620328 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 249/527] 10.222.0.62 () {60 vars in 1146 bytes} [Tue Jul 12 17:30:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:30:26.627202 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=36 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:30:26.628141 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=4 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:30:26.629560 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:30:26.634203 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f07a402f-0468-49da-b875-06bdad4fc053 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:26.634914 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f07a402f-0468-49da-b875-06bdad4fc053 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:26.693045 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f07a402f-0468-49da-b875-06bdad4fc053 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:26.700837 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f07a402f-0468-49da-b875-06bdad4fc053 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1095 microversion: 2.1 time: 0.073608 Jul 12 17:30:26.701414 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 279/528] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:26 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:27.718192 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d79d6744-5a3a-44ba-9808-acbecd1feadb tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:27.719503 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d79d6744-5a3a-44ba-9808-acbecd1feadb tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:27.727559 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d79d6744-5a3a-44ba-9808-acbecd1feadb tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:27.729060 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d79d6744-5a3a-44ba-9808-acbecd1feadb tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:27.729889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d79d6744-5a3a-44ba-9808-acbecd1feadb tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:27.730424 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d79d6744-5a3a-44ba-9808-acbecd1feadb tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:27.802417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d79d6744-5a3a-44ba-9808-acbecd1feadb tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:27.810362 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d79d6744-5a3a-44ba-9808-acbecd1feadb tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1211 microversion: 2.1 time: 0.095794 Jul 12 17:30:27.810934 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 250/529] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:27 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:28.828747 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-20b8f4e7-1cc7-4650-afaa-f18089337dbd tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:28.829413 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-20b8f4e7-1cc7-4650-afaa-f18089337dbd tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:28.837037 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-20b8f4e7-1cc7-4650-afaa-f18089337dbd tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:28.837492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-20b8f4e7-1cc7-4650-afaa-f18089337dbd tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:28.838525 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-20b8f4e7-1cc7-4650-afaa-f18089337dbd tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:28.838956 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-20b8f4e7-1cc7-4650-afaa-f18089337dbd tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:29.056366 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-20b8f4e7-1cc7-4650-afaa-f18089337dbd tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:29.068150 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-20b8f4e7-1cc7-4650-afaa-f18089337dbd tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1266 microversion: 2.1 time: 0.243884 Jul 12 17:30:29.069074 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 280/530] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:28 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:29.180933 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-61eb3b9c-79d4-4f7e-9df6-86658dbbe610 req-47dd2c48-8de3-405b-a426-c8ceb5da17fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a152ab-692f-42e7-9c24-a69291f449ae", "tag": "3805d085-cefa-43b1-a617-e660f2c6e92e"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:30:29.200965 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-61eb3b9c-79d4-4f7e-9df6-86658dbbe610 req-47dd2c48-8de3-405b-a426-c8ceb5da17fd service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:29.201899 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-61eb3b9c-79d4-4f7e-9df6-86658dbbe610 req-47dd2c48-8de3-405b-a426-c8ceb5da17fd service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:29.219284 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-61eb3b9c-79d4-4f7e-9df6-86658dbbe610 req-47dd2c48-8de3-405b-a426-c8ceb5da17fd service nova] Creating event network-changed:3805d085-cefa-43b1-a617-e660f2c6e92e for instance 75a152ab-692f-42e7-9c24-a69291f449ae on hv-cinder-84932 Jul 12 17:30:29.225147 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-61eb3b9c-79d4-4f7e-9df6-86658dbbe610 req-47dd2c48-8de3-405b-a426-c8ceb5da17fd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049388 Jul 12 17:30:29.226202 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 251/531] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:30:30.086873 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cac44084-fc19-4971-b04f-3ffa6fe55d1b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:30.087524 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cac44084-fc19-4971-b04f-3ffa6fe55d1b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:30.093562 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cac44084-fc19-4971-b04f-3ffa6fe55d1b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:30.094035 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cac44084-fc19-4971-b04f-3ffa6fe55d1b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:30.094790 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cac44084-fc19-4971-b04f-3ffa6fe55d1b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:30.095218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cac44084-fc19-4971-b04f-3ffa6fe55d1b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:30.231847 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cac44084-fc19-4971-b04f-3ffa6fe55d1b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:30.239543 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cac44084-fc19-4971-b04f-3ffa6fe55d1b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1266 microversion: 2.1 time: 0.156616 Jul 12 17:30:30.240104 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 281/532] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:30 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:31.257336 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a6190bdf-b7aa-49c4-a432-0102a4df4931 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:31.258077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a6190bdf-b7aa-49c4-a432-0102a4df4931 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:31.264445 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a6190bdf-b7aa-49c4-a432-0102a4df4931 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:31.264899 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a6190bdf-b7aa-49c4-a432-0102a4df4931 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:31.265814 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a6190bdf-b7aa-49c4-a432-0102a4df4931 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:31.266477 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a6190bdf-b7aa-49c4-a432-0102a4df4931 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:31.475512 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a6190bdf-b7aa-49c4-a432-0102a4df4931 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:31.483554 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a6190bdf-b7aa-49c4-a432-0102a4df4931 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1266 microversion: 2.1 time: 0.230894 Jul 12 17:30:31.484130 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 252/533] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:31 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:32.500397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bf1b0906-a27f-4f8f-a238-15fb7d72b2c3 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:32.501001 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bf1b0906-a27f-4f8f-a238-15fb7d72b2c3 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:32.507200 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bf1b0906-a27f-4f8f-a238-15fb7d72b2c3 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:32.507681 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bf1b0906-a27f-4f8f-a238-15fb7d72b2c3 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:32.508443 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bf1b0906-a27f-4f8f-a238-15fb7d72b2c3 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:32.508877 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bf1b0906-a27f-4f8f-a238-15fb7d72b2c3 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:32.642525 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bf1b0906-a27f-4f8f-a238-15fb7d72b2c3 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:32.650127 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bf1b0906-a27f-4f8f-a238-15fb7d72b2c3 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1266 microversion: 2.1 time: 0.153478 Jul 12 17:30:32.650683 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 282/534] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:32 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:33.667042 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-499cef0f-295f-4b28-8247-cfc3aa9dc27f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:33.667582 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-499cef0f-295f-4b28-8247-cfc3aa9dc27f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:33.673784 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-499cef0f-295f-4b28-8247-cfc3aa9dc27f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:33.674232 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-499cef0f-295f-4b28-8247-cfc3aa9dc27f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:33.675001 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-499cef0f-295f-4b28-8247-cfc3aa9dc27f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:33.675921 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-499cef0f-295f-4b28-8247-cfc3aa9dc27f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:33.809024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-499cef0f-295f-4b28-8247-cfc3aa9dc27f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:33.817428 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-499cef0f-295f-4b28-8247-cfc3aa9dc27f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1266 microversion: 2.1 time: 0.154463 Jul 12 17:30:33.818022 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 253/535] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:33 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:30:33.941425 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-83fe244a-9d01-41ba-a4b6-78a0e335c0a7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:33.941958 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-83fe244a-9d01-41ba-a4b6-78a0e335c0a7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:33.949854 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-83fe244a-9d01-41ba-a4b6-78a0e335c0a7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:33.950306 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-83fe244a-9d01-41ba-a4b6-78a0e335c0a7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:33.951077 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-83fe244a-9d01-41ba-a4b6-78a0e335c0a7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:33.951513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-83fe244a-9d01-41ba-a4b6-78a0e335c0a7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:33.975755 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-83fe244a-9d01-41ba-a4b6-78a0e335c0a7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/ips" status: 200 len: 153 microversion: 2.20 time: 0.038381 Jul 12 17:30:33.976326 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 283/536] 10.222.0.62 () {60 vars in 1288 bytes} [Tue Jul 12 17:30:33 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/ips => generated 153 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:30:34.835057 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2c77f898-8791-4e3e-af14-68485b0961fa tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:34.835669 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2c77f898-8791-4e3e-af14-68485b0961fa tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:34.842110 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c77f898-8791-4e3e-af14-68485b0961fa tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:34.842561 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c77f898-8791-4e3e-af14-68485b0961fa tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:34.843324 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c77f898-8791-4e3e-af14-68485b0961fa tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:34.843761 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c77f898-8791-4e3e-af14-68485b0961fa tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:34.977891 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2c77f898-8791-4e3e-af14-68485b0961fa tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:34.985345 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2c77f898-8791-4e3e-af14-68485b0961fa tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1266 microversion: 2.1 time: 0.154754 Jul 12 17:30:34.985946 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 254/537] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:34 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:35.907377 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-63f84b2f-104c-4fd7-a047-3971809e2c0f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:30:35.907910 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-63f84b2f-104c-4fd7-a047-3971809e2c0f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:35.914845 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-63f84b2f-104c-4fd7-a047-3971809e2c0f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:35.915286 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-63f84b2f-104c-4fd7-a047-3971809e2c0f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:35.916066 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-63f84b2f-104c-4fd7-a047-3971809e2c0f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:35.916500 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-63f84b2f-104c-4fd7-a047-3971809e2c0f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:35.938561 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-63f84b2f-104c-4fd7-a047-3971809e2c0f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lazy-loading 'flavor' on Instance uuid 48b5e50f-5079-438b-ac33-67623b4428f5 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:30:36.002703 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7d85aca7-3acc-4564-8fa8-3b955f5e31c8 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:36.003318 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7d85aca7-3acc-4564-8fa8-3b955f5e31c8 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:36.010312 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7d85aca7-3acc-4564-8fa8-3b955f5e31c8 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:36.010312 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7d85aca7-3acc-4564-8fa8-3b955f5e31c8 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:36.011077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7d85aca7-3acc-4564-8fa8-3b955f5e31c8 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:36.011515 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7d85aca7-3acc-4564-8fa8-3b955f5e31c8 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:36.141375 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7d85aca7-3acc-4564-8fa8-3b955f5e31c8 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:36.150018 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7d85aca7-3acc-4564-8fa8-3b955f5e31c8 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1266 microversion: 2.1 time: 0.151049 Jul 12 17:30:36.150759 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 255/538] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:35 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:36.193063 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-63f84b2f-104c-4fd7-a047-3971809e2c0f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "POST /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/action" status: 202 len: 0 microversion: 2.20 time: 0.289431 Jul 12 17:30:36.193701 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 284/539] 10.222.0.62 () {62 vars in 1318 bytes} [Tue Jul 12 17:30:35 2022] POST /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:30:36.202161 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-36f2f45e-fafa-423d-8e25-dbfb5480b8bb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:36.202770 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-36f2f45e-fafa-423d-8e25-dbfb5480b8bb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:36.209595 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-36f2f45e-fafa-423d-8e25-dbfb5480b8bb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:36.210091 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-36f2f45e-fafa-423d-8e25-dbfb5480b8bb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:36.210855 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-36f2f45e-fafa-423d-8e25-dbfb5480b8bb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:36.211289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-36f2f45e-fafa-423d-8e25-dbfb5480b8bb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:36.339702 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-36f2f45e-fafa-423d-8e25-dbfb5480b8bb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:36.347502 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-36f2f45e-fafa-423d-8e25-dbfb5480b8bb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:36.349025 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-36f2f45e-fafa-423d-8e25-dbfb5480b8bb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:36.350213 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-36f2f45e-fafa-423d-8e25-dbfb5480b8bb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1725 microversion: 2.20 time: 0.151923 Jul 12 17:30:36.350791 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 256/540] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:30:36 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:30:37.164379 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:30:37.168685 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b4d23598-ca14-407d-b7ff-7320ef8af724 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:37.169383 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b4d23598-ca14-407d-b7ff-7320ef8af724 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:37.176504 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b4d23598-ca14-407d-b7ff-7320ef8af724 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:37.176954 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b4d23598-ca14-407d-b7ff-7320ef8af724 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:37.177734 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b4d23598-ca14-407d-b7ff-7320ef8af724 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:37.178174 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b4d23598-ca14-407d-b7ff-7320ef8af724 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:37.304802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b4d23598-ca14-407d-b7ff-7320ef8af724 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:37.312209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b4d23598-ca14-407d-b7ff-7320ef8af724 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1266 microversion: 2.1 time: 0.148863 Jul 12 17:30:37.312772 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 285/541] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:37 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:37.368349 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e29e0620-df28-49b1-8402-443012ea92f1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:37.368882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e29e0620-df28-49b1-8402-443012ea92f1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:37.370814 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:30:37.371619 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=6 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:30:37.377892 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e29e0620-df28-49b1-8402-443012ea92f1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:37.378480 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e29e0620-df28-49b1-8402-443012ea92f1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:37.379297 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e29e0620-df28-49b1-8402-443012ea92f1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:37.379730 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e29e0620-df28-49b1-8402-443012ea92f1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:37.504347 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e29e0620-df28-49b1-8402-443012ea92f1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:37.512271 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e29e0620-df28-49b1-8402-443012ea92f1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:37.513797 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e29e0620-df28-49b1-8402-443012ea92f1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:37.514939 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e29e0620-df28-49b1-8402-443012ea92f1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1725 microversion: 2.20 time: 0.150640 Jul 12 17:30:37.515483 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 257/542] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:30:37 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:30:38.329222 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6a087332-931d-4e67-92a9-45dbdbbd1e9a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:38.329853 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6a087332-931d-4e67-92a9-45dbdbbd1e9a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:38.335777 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6a087332-931d-4e67-92a9-45dbdbbd1e9a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:38.336219 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6a087332-931d-4e67-92a9-45dbdbbd1e9a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:38.336963 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6a087332-931d-4e67-92a9-45dbdbbd1e9a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:38.337392 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6a087332-931d-4e67-92a9-45dbdbbd1e9a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:38.465103 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6a087332-931d-4e67-92a9-45dbdbbd1e9a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:38.472847 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6a087332-931d-4e67-92a9-45dbdbbd1e9a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1266 microversion: 2.1 time: 0.147480 Jul 12 17:30:38.473407 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 286/543] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:38 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:38.533203 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3ac6e2de-639b-4dbf-b096-af0c12f7a700 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:38.533845 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3ac6e2de-639b-4dbf-b096-af0c12f7a700 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:38.540469 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3ac6e2de-639b-4dbf-b096-af0c12f7a700 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:38.540914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3ac6e2de-639b-4dbf-b096-af0c12f7a700 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:38.541675 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3ac6e2de-639b-4dbf-b096-af0c12f7a700 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:38.542130 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3ac6e2de-639b-4dbf-b096-af0c12f7a700 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:38.667598 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3ac6e2de-639b-4dbf-b096-af0c12f7a700 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:38.681978 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3ac6e2de-639b-4dbf-b096-af0c12f7a700 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:38.683491 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3ac6e2de-639b-4dbf-b096-af0c12f7a700 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:38.684660 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3ac6e2de-639b-4dbf-b096-af0c12f7a700 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1725 microversion: 2.20 time: 0.155300 Jul 12 17:30:38.685217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 258/544] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:30:38 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:30:39.490065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d827f6f9-c129-41ae-b280-c6a6373d6436 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:39.490679 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d827f6f9-c129-41ae-b280-c6a6373d6436 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:39.496692 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d827f6f9-c129-41ae-b280-c6a6373d6436 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:39.497141 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d827f6f9-c129-41ae-b280-c6a6373d6436 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:39.497941 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d827f6f9-c129-41ae-b280-c6a6373d6436 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:39.498377 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d827f6f9-c129-41ae-b280-c6a6373d6436 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:39.633846 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d827f6f9-c129-41ae-b280-c6a6373d6436 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:39.641147 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d827f6f9-c129-41ae-b280-c6a6373d6436 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1266 microversion: 2.1 time: 0.155540 Jul 12 17:30:39.641733 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 287/545] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:39 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:39.703053 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ad41a89e-09e0-4983-afba-28f24ced5e0d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:39.703601 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ad41a89e-09e0-4983-afba-28f24ced5e0d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:39.712152 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ad41a89e-09e0-4983-afba-28f24ced5e0d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:39.712601 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ad41a89e-09e0-4983-afba-28f24ced5e0d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:39.713368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ad41a89e-09e0-4983-afba-28f24ced5e0d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:39.713833 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ad41a89e-09e0-4983-afba-28f24ced5e0d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:39.840184 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ad41a89e-09e0-4983-afba-28f24ced5e0d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:39.848511 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ad41a89e-09e0-4983-afba-28f24ced5e0d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:39.850063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ad41a89e-09e0-4983-afba-28f24ced5e0d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:39.851220 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ad41a89e-09e0-4983-afba-28f24ced5e0d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1725 microversion: 2.20 time: 0.152157 Jul 12 17:30:39.851776 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 259/546] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:30:39 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:30:40.658695 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a08e5a83-13ea-4ee4-a301-6e0527730189 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:40.659347 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a08e5a83-13ea-4ee4-a301-6e0527730189 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:40.666117 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a08e5a83-13ea-4ee4-a301-6e0527730189 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:40.666565 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a08e5a83-13ea-4ee4-a301-6e0527730189 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:40.667320 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a08e5a83-13ea-4ee4-a301-6e0527730189 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:40.667752 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a08e5a83-13ea-4ee4-a301-6e0527730189 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:40.801416 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a08e5a83-13ea-4ee4-a301-6e0527730189 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:40.808830 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a08e5a83-13ea-4ee4-a301-6e0527730189 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1266 microversion: 2.1 time: 0.154123 Jul 12 17:30:40.809391 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 288/547] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:40 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:40.868229 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ca911e54-4802-4122-9983-dab0b4708f92 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:40.868843 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ca911e54-4802-4122-9983-dab0b4708f92 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:40.875219 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ca911e54-4802-4122-9983-dab0b4708f92 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:40.875671 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ca911e54-4802-4122-9983-dab0b4708f92 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:40.876441 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ca911e54-4802-4122-9983-dab0b4708f92 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:40.876879 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ca911e54-4802-4122-9983-dab0b4708f92 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:41.001786 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ca911e54-4802-4122-9983-dab0b4708f92 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:41.010245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ca911e54-4802-4122-9983-dab0b4708f92 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:41.011809 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ca911e54-4802-4122-9983-dab0b4708f92 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:41.012971 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ca911e54-4802-4122-9983-dab0b4708f92 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1725 microversion: 2.20 time: 0.148632 Jul 12 17:30:41.013525 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 260/548] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:30:40 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:30:41.524022 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-83b514bc-2423-4286-866c-94be3dfae8a7 req-0c458973-df34-4f46-9bda-dc332ecfea3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a152ab-692f-42e7-9c24-a69291f449ae", "name": "network-vif-plugged", "status": "completed", "tag": "3805d085-cefa-43b1-a617-e660f2c6e92e"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:30:41.533538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-83b514bc-2423-4286-866c-94be3dfae8a7 req-0c458973-df34-4f46-9bda-dc332ecfea3c service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:41.534101 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-83b514bc-2423-4286-866c-94be3dfae8a7 req-0c458973-df34-4f46-9bda-dc332ecfea3c service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:41.546908 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-83b514bc-2423-4286-866c-94be3dfae8a7 req-0c458973-df34-4f46-9bda-dc332ecfea3c service nova] Creating event network-vif-plugged:3805d085-cefa-43b1-a617-e660f2c6e92e for instance 75a152ab-692f-42e7-9c24-a69291f449ae on hv-cinder-84932 Jul 12 17:30:41.552440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-83b514bc-2423-4286-866c-94be3dfae8a7 req-0c458973-df34-4f46-9bda-dc332ecfea3c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032167 Jul 12 17:30:41.553105 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 289/549] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:30:41.826673 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f6a21938-b9ad-4721-b20c-24873d3f751d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:41.827401 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f6a21938-b9ad-4721-b20c-24873d3f751d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:41.834102 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f6a21938-b9ad-4721-b20c-24873d3f751d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:41.834624 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f6a21938-b9ad-4721-b20c-24873d3f751d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:41.835484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f6a21938-b9ad-4721-b20c-24873d3f751d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:41.835993 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f6a21938-b9ad-4721-b20c-24873d3f751d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:41.989044 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f6a21938-b9ad-4721-b20c-24873d3f751d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:41.996347 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f6a21938-b9ad-4721-b20c-24873d3f751d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1266 microversion: 2.1 time: 0.173681 Jul 12 17:30:41.996903 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 261/550] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:41 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:42.031870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7c5bf453-6a46-44ac-9a66-74cfc12a20e9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:42.032479 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7c5bf453-6a46-44ac-9a66-74cfc12a20e9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:42.039251 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c5bf453-6a46-44ac-9a66-74cfc12a20e9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:42.039690 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c5bf453-6a46-44ac-9a66-74cfc12a20e9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:42.040435 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c5bf453-6a46-44ac-9a66-74cfc12a20e9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:42.040866 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7c5bf453-6a46-44ac-9a66-74cfc12a20e9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:42.165608 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7c5bf453-6a46-44ac-9a66-74cfc12a20e9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:42.173280 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7c5bf453-6a46-44ac-9a66-74cfc12a20e9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:42.174802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7c5bf453-6a46-44ac-9a66-74cfc12a20e9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:42.175971 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7c5bf453-6a46-44ac-9a66-74cfc12a20e9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1725 microversion: 2.20 time: 0.148608 Jul 12 17:30:42.176516 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 290/551] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:30:42 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:30:43.013756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-754fbdd4-6191-489a-bfa6-7e1a2ac0d97c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:43.014367 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-754fbdd4-6191-489a-bfa6-7e1a2ac0d97c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:43.020850 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-754fbdd4-6191-489a-bfa6-7e1a2ac0d97c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:43.021237 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-754fbdd4-6191-489a-bfa6-7e1a2ac0d97c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:43.022066 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-754fbdd4-6191-489a-bfa6-7e1a2ac0d97c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:43.022498 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-754fbdd4-6191-489a-bfa6-7e1a2ac0d97c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:43.153224 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-754fbdd4-6191-489a-bfa6-7e1a2ac0d97c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:43.161001 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-754fbdd4-6191-489a-bfa6-7e1a2ac0d97c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1266 microversion: 2.1 time: 0.151118 Jul 12 17:30:43.161552 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 262/552] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:43 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:43.195454 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e67fa7ab-3160-4159-8c77-42199874e6d5 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:43.196491 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e67fa7ab-3160-4159-8c77-42199874e6d5 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:43.205288 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e67fa7ab-3160-4159-8c77-42199874e6d5 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:43.205761 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e67fa7ab-3160-4159-8c77-42199874e6d5 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:43.206555 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e67fa7ab-3160-4159-8c77-42199874e6d5 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:43.206985 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e67fa7ab-3160-4159-8c77-42199874e6d5 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:43.330570 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e67fa7ab-3160-4159-8c77-42199874e6d5 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:43.338875 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e67fa7ab-3160-4159-8c77-42199874e6d5 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:43.340375 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e67fa7ab-3160-4159-8c77-42199874e6d5 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:43.341512 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e67fa7ab-3160-4159-8c77-42199874e6d5 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1725 microversion: 2.20 time: 0.151581 Jul 12 17:30:43.342103 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 291/553] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:30:43 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:30:44.177966 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c9705b53-39d4-44b1-8e3e-b2cb6c098504 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:44.178572 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c9705b53-39d4-44b1-8e3e-b2cb6c098504 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:44.184946 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c9705b53-39d4-44b1-8e3e-b2cb6c098504 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:44.185393 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c9705b53-39d4-44b1-8e3e-b2cb6c098504 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:44.186183 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c9705b53-39d4-44b1-8e3e-b2cb6c098504 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:44.186622 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c9705b53-39d4-44b1-8e3e-b2cb6c098504 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:44.311866 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c9705b53-39d4-44b1-8e3e-b2cb6c098504 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:44.320084 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c9705b53-39d4-44b1-8e3e-b2cb6c098504 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1452 microversion: 2.1 time: 0.146536 Jul 12 17:30:44.320643 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 263/554] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:44 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:44.335858 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-89009cfd-b672-4ab3-892f-7f33fdc63283 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:44.336474 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-89009cfd-b672-4ab3-892f-7f33fdc63283 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:44.342592 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-89009cfd-b672-4ab3-892f-7f33fdc63283 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:44.343046 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-89009cfd-b672-4ab3-892f-7f33fdc63283 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:44.343832 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-89009cfd-b672-4ab3-892f-7f33fdc63283 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:44.344268 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-89009cfd-b672-4ab3-892f-7f33fdc63283 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:44.360237 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1887dad3-8204-4677-ad62-3582373fecb9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:44.360842 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1887dad3-8204-4677-ad62-3582373fecb9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:44.367171 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1887dad3-8204-4677-ad62-3582373fecb9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:44.367617 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1887dad3-8204-4677-ad62-3582373fecb9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:44.368370 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1887dad3-8204-4677-ad62-3582373fecb9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:44.368803 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1887dad3-8204-4677-ad62-3582373fecb9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:44.533089 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-89009cfd-b672-4ab3-892f-7f33fdc63283 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:44.541057 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-89009cfd-b672-4ab3-892f-7f33fdc63283 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1452 microversion: 2.1 time: 0.209106 Jul 12 17:30:44.541932 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 292/555] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:44 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1452 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:44.544177 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1887dad3-8204-4677-ad62-3582373fecb9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:44.552086 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1887dad3-8204-4677-ad62-3582373fecb9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:44.553604 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1887dad3-8204-4677-ad62-3582373fecb9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:44.554815 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1887dad3-8204-4677-ad62-3582373fecb9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1725 microversion: 2.20 time: 0.198371 Jul 12 17:30:44.555368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 264/556] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:30:44 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:30:45.574208 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-024e60d5-5f43-4dcf-a575-897c4e0abf54 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:45.575115 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-024e60d5-5f43-4dcf-a575-897c4e0abf54 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:45.581012 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-024e60d5-5f43-4dcf-a575-897c4e0abf54 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:45.581463 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-024e60d5-5f43-4dcf-a575-897c4e0abf54 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:45.582271 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-024e60d5-5f43-4dcf-a575-897c4e0abf54 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:45.582709 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-024e60d5-5f43-4dcf-a575-897c4e0abf54 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:45.961314 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-024e60d5-5f43-4dcf-a575-897c4e0abf54 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:45.969354 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-024e60d5-5f43-4dcf-a575-897c4e0abf54 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:45.970879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-024e60d5-5f43-4dcf-a575-897c4e0abf54 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:45.972563 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-024e60d5-5f43-4dcf-a575-897c4e0abf54 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1725 microversion: 2.20 time: 0.403246 Jul 12 17:30:45.973108 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 293/557] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:30:45 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1725 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:30:46.218619 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-7bf69abf-6a15-4cf4-b75a-39314cc4d339 req-8bcf0a7b-e2c2-4721-a9bf-be1a4d0a3f0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a152ab-692f-42e7-9c24-a69291f449ae", "tag": "3805d085-cefa-43b1-a617-e660f2c6e92e"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:30:46.228722 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-7bf69abf-6a15-4cf4-b75a-39314cc4d339 req-8bcf0a7b-e2c2-4721-a9bf-be1a4d0a3f0b service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:46.229166 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-7bf69abf-6a15-4cf4-b75a-39314cc4d339 req-8bcf0a7b-e2c2-4721-a9bf-be1a4d0a3f0b service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:46.241360 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-7bf69abf-6a15-4cf4-b75a-39314cc4d339 req-8bcf0a7b-e2c2-4721-a9bf-be1a4d0a3f0b service nova] Creating event network-changed:3805d085-cefa-43b1-a617-e660f2c6e92e for instance 75a152ab-692f-42e7-9c24-a69291f449ae on hv-cinder-84932 Jul 12 17:30:46.246443 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-7bf69abf-6a15-4cf4-b75a-39314cc4d339 req-8bcf0a7b-e2c2-4721-a9bf-be1a4d0a3f0b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031910 Jul 12 17:30:46.247051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 265/558] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:30:46.991242 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-37f9c772-6de2-4468-bd88-9f47a34211e1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:46.991855 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-37f9c772-6de2-4468-bd88-9f47a34211e1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:46.998060 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37f9c772-6de2-4468-bd88-9f47a34211e1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:46.998506 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37f9c772-6de2-4468-bd88-9f47a34211e1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:46.999486 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37f9c772-6de2-4468-bd88-9f47a34211e1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:46.999924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37f9c772-6de2-4468-bd88-9f47a34211e1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:47.152356 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-37f9c772-6de2-4468-bd88-9f47a34211e1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:47.160817 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-37f9c772-6de2-4468-bd88-9f47a34211e1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:47.162362 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-37f9c772-6de2-4468-bd88-9f47a34211e1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:47.163498 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-37f9c772-6de2-4468-bd88-9f47a34211e1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1725 microversion: 2.20 time: 0.176778 Jul 12 17:30:47.164060 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 294/559] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:30:46 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:30:48.182738 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-39824ae4-038a-4b75-a488-ab925e2692cd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:48.183428 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-39824ae4-038a-4b75-a488-ab925e2692cd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:48.189759 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-39824ae4-038a-4b75-a488-ab925e2692cd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:48.190211 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-39824ae4-038a-4b75-a488-ab925e2692cd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:48.191459 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-39824ae4-038a-4b75-a488-ab925e2692cd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:48.191892 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-39824ae4-038a-4b75-a488-ab925e2692cd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:48.321841 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-39824ae4-038a-4b75-a488-ab925e2692cd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:48.329577 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-39824ae4-038a-4b75-a488-ab925e2692cd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:48.331778 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-39824ae4-038a-4b75-a488-ab925e2692cd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:48.332919 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-39824ae4-038a-4b75-a488-ab925e2692cd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1725 microversion: 2.20 time: 0.155044 Jul 12 17:30:48.333481 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 266/560] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:30:48 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:30:48.982841 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8e5a71e2-764f-4557-9f1b-9f5b9370f077 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:30:48.983681 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8e5a71e2-764f-4557-9f1b-9f5b9370f077 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:48.990454 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8e5a71e2-764f-4557-9f1b-9f5b9370f077 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:48.990894 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8e5a71e2-764f-4557-9f1b-9f5b9370f077 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:48.991643 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8e5a71e2-764f-4557-9f1b-9f5b9370f077 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:48.992066 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8e5a71e2-764f-4557-9f1b-9f5b9370f077 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:49.010326 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:30:49.063527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8e5a71e2-764f-4557-9f1b-9f5b9370f077 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "POST /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f/action" status: 202 len: 0 microversion: 2.1 time: 0.084504 Jul 12 17:30:49.064326 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 295/561] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Jul 12 17:30:48 2022] POST /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:30:49.072838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b058cd80-919e-4a06-a9b6-61a85defcb51 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:49.073482 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b058cd80-919e-4a06-a9b6-61a85defcb51 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:49.079654 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b058cd80-919e-4a06-a9b6-61a85defcb51 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:49.080084 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b058cd80-919e-4a06-a9b6-61a85defcb51 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:49.080865 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b058cd80-919e-4a06-a9b6-61a85defcb51 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:49.081379 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b058cd80-919e-4a06-a9b6-61a85defcb51 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:49.101513 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:30:49.323806 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b058cd80-919e-4a06-a9b6-61a85defcb51 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:49.332408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b058cd80-919e-4a06-a9b6-61a85defcb51 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1750 microversion: 2.1 time: 0.263973 Jul 12 17:30:49.332986 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 267/562] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:49 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1750 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:49.352489 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-eb1d3d19-0aeb-4530-94d9-9585093ea7b8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:49.353265 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-eb1d3d19-0aeb-4530-94d9-9585093ea7b8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:49.359582 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eb1d3d19-0aeb-4530-94d9-9585093ea7b8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:49.360027 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eb1d3d19-0aeb-4530-94d9-9585093ea7b8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:49.360781 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eb1d3d19-0aeb-4530-94d9-9585093ea7b8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:49.361205 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eb1d3d19-0aeb-4530-94d9-9585093ea7b8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:49.534942 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-eb1d3d19-0aeb-4530-94d9-9585093ea7b8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:49.542760 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-eb1d3d19-0aeb-4530-94d9-9585093ea7b8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:49.544352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-eb1d3d19-0aeb-4530-94d9-9585093ea7b8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:49.545542 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-eb1d3d19-0aeb-4530-94d9-9585093ea7b8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1725 microversion: 2.20 time: 0.197400 Jul 12 17:30:49.546143 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 296/563] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:30:49 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:30:50.350552 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f3f8c67c-b98e-4f77-bae0-23d5abfea420 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:50.351163 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f3f8c67c-b98e-4f77-bae0-23d5abfea420 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:50.357591 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f3f8c67c-b98e-4f77-bae0-23d5abfea420 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:50.358070 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f3f8c67c-b98e-4f77-bae0-23d5abfea420 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:50.358830 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f3f8c67c-b98e-4f77-bae0-23d5abfea420 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:50.359267 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f3f8c67c-b98e-4f77-bae0-23d5abfea420 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:50.496800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f3f8c67c-b98e-4f77-bae0-23d5abfea420 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:50.504580 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f3f8c67c-b98e-4f77-bae0-23d5abfea420 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1755 microversion: 2.1 time: 0.157940 Jul 12 17:30:50.505136 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 268/564] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:50 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:50.563464 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-13dd1d36-73aa-4bd5-ae5f-bcc1b5fbe3b6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:50.564061 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-13dd1d36-73aa-4bd5-ae5f-bcc1b5fbe3b6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:50.570191 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13dd1d36-73aa-4bd5-ae5f-bcc1b5fbe3b6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:50.570634 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13dd1d36-73aa-4bd5-ae5f-bcc1b5fbe3b6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:50.571421 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13dd1d36-73aa-4bd5-ae5f-bcc1b5fbe3b6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:50.571834 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13dd1d36-73aa-4bd5-ae5f-bcc1b5fbe3b6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:50.750654 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-13dd1d36-73aa-4bd5-ae5f-bcc1b5fbe3b6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:50.758614 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-13dd1d36-73aa-4bd5-ae5f-bcc1b5fbe3b6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:50.760122 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-13dd1d36-73aa-4bd5-ae5f-bcc1b5fbe3b6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:50.761938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-13dd1d36-73aa-4bd5-ae5f-bcc1b5fbe3b6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1746 microversion: 2.20 time: 0.202233 Jul 12 17:30:50.762494 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 297/565] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:30:50 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1746 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:30:51.521819 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-273f3322-b887-4180-b4e9-6c7fdf417fa9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:51.522476 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-273f3322-b887-4180-b4e9-6c7fdf417fa9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:51.528736 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-273f3322-b887-4180-b4e9-6c7fdf417fa9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:51.529185 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-273f3322-b887-4180-b4e9-6c7fdf417fa9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:51.529993 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-273f3322-b887-4180-b4e9-6c7fdf417fa9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:51.530426 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-273f3322-b887-4180-b4e9-6c7fdf417fa9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:51.726061 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-273f3322-b887-4180-b4e9-6c7fdf417fa9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:51.733969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-273f3322-b887-4180-b4e9-6c7fdf417fa9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1755 microversion: 2.1 time: 0.215994 Jul 12 17:30:51.734529 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 269/566] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:51 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1755 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:51.780778 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7d6685d8-a94c-48fb-9f60-109792cf48f0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:51.781394 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7d6685d8-a94c-48fb-9f60-109792cf48f0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:51.787391 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7d6685d8-a94c-48fb-9f60-109792cf48f0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:51.787839 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7d6685d8-a94c-48fb-9f60-109792cf48f0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:51.788597 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7d6685d8-a94c-48fb-9f60-109792cf48f0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:51.789025 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7d6685d8-a94c-48fb-9f60-109792cf48f0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:51.917102 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7d6685d8-a94c-48fb-9f60-109792cf48f0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:51.925617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7d6685d8-a94c-48fb-9f60-109792cf48f0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:51.927147 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7d6685d8-a94c-48fb-9f60-109792cf48f0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:51.928287 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7d6685d8-a94c-48fb-9f60-109792cf48f0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1746 microversion: 2.20 time: 0.151426 Jul 12 17:30:51.928840 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 298/567] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:30:51 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:30:52.751496 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cd97a90c-645b-4c01-a8f2-ff7d21c83442 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:52.752122 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-cd97a90c-645b-4c01-a8f2-ff7d21c83442 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:52.759208 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cd97a90c-645b-4c01-a8f2-ff7d21c83442 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:52.759653 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cd97a90c-645b-4c01-a8f2-ff7d21c83442 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:52.760408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cd97a90c-645b-4c01-a8f2-ff7d21c83442 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:52.760838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cd97a90c-645b-4c01-a8f2-ff7d21c83442 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:52.905120 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cd97a90c-645b-4c01-a8f2-ff7d21c83442 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:52.913585 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-cd97a90c-645b-4c01-a8f2-ff7d21c83442 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1755 microversion: 2.1 time: 0.166003 Jul 12 17:30:52.914193 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 270/568] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:52 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:52.947038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f608cf48-909b-46b5-b92b-16c41092ff20 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:52.947642 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f608cf48-909b-46b5-b92b-16c41092ff20 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:52.953479 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f608cf48-909b-46b5-b92b-16c41092ff20 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:52.953948 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f608cf48-909b-46b5-b92b-16c41092ff20 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:52.954692 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f608cf48-909b-46b5-b92b-16c41092ff20 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:52.955125 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f608cf48-909b-46b5-b92b-16c41092ff20 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:53.082218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f608cf48-909b-46b5-b92b-16c41092ff20 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:53.090104 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f608cf48-909b-46b5-b92b-16c41092ff20 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:53.091592 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f608cf48-909b-46b5-b92b-16c41092ff20 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:53.092729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f608cf48-909b-46b5-b92b-16c41092ff20 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1746 microversion: 2.20 time: 0.149868 Jul 12 17:30:53.093285 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 299/569] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:30:52 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:30:53.569720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-7294dce9-5165-46cc-a4ff-4b391f794b63 req-f52f00b7-d5c5-46bb-9b2c-95c332e81fbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b5e50f-5079-438b-ac33-67623b4428f5", "name": "network-vif-plugged", "status": "completed", "tag": "e0dd8828-dbc7-4d01-9d3f-ee997fb3d5ce"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:30:53.578207 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-7294dce9-5165-46cc-a4ff-4b391f794b63 req-f52f00b7-d5c5-46bb-9b2c-95c332e81fbd service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:53.578649 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-7294dce9-5165-46cc-a4ff-4b391f794b63 req-f52f00b7-d5c5-46bb-9b2c-95c332e81fbd service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:53.590155 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-7294dce9-5165-46cc-a4ff-4b391f794b63 req-f52f00b7-d5c5-46bb-9b2c-95c332e81fbd service nova] Creating event network-vif-plugged:e0dd8828-dbc7-4d01-9d3f-ee997fb3d5ce for instance 48b5e50f-5079-438b-ac33-67623b4428f5 on hv-cinder-84932 Jul 12 17:30:53.594848 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-7294dce9-5165-46cc-a4ff-4b391f794b63 req-f52f00b7-d5c5-46bb-9b2c-95c332e81fbd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029225 Jul 12 17:30:53.595527 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 271/570] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:30:53.929893 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d740f70c-fde5-45b2-98ad-10c202e37445 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:53.930504 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d740f70c-fde5-45b2-98ad-10c202e37445 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:53.936458 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d740f70c-fde5-45b2-98ad-10c202e37445 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:53.936898 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d740f70c-fde5-45b2-98ad-10c202e37445 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:53.937655 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d740f70c-fde5-45b2-98ad-10c202e37445 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:53.938112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d740f70c-fde5-45b2-98ad-10c202e37445 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:54.080068 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d740f70c-fde5-45b2-98ad-10c202e37445 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:54.088388 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d740f70c-fde5-45b2-98ad-10c202e37445 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1755 microversion: 2.1 time: 0.162409 Jul 12 17:30:54.088949 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 300/571] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:53 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:54.111474 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1c531de8-df55-47d6-9b9d-818778c49ccf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:54.112246 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1c531de8-df55-47d6-9b9d-818778c49ccf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:54.118336 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c531de8-df55-47d6-9b9d-818778c49ccf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:54.118780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c531de8-df55-47d6-9b9d-818778c49ccf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:54.119568 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c531de8-df55-47d6-9b9d-818778c49ccf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:54.120003 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c531de8-df55-47d6-9b9d-818778c49ccf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:54.246106 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1c531de8-df55-47d6-9b9d-818778c49ccf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:54.254363 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1c531de8-df55-47d6-9b9d-818778c49ccf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:54.255872 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1c531de8-df55-47d6-9b9d-818778c49ccf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:54.257011 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1c531de8-df55-47d6-9b9d-818778c49ccf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1746 microversion: 2.20 time: 0.150272 Jul 12 17:30:54.257570 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 272/572] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:30:54 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:30:55.105804 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b889b27d-7144-40cc-9503-8a9c2f8499fa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:55.106412 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b889b27d-7144-40cc-9503-8a9c2f8499fa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:55.113060 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b889b27d-7144-40cc-9503-8a9c2f8499fa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:55.113506 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b889b27d-7144-40cc-9503-8a9c2f8499fa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:55.114292 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b889b27d-7144-40cc-9503-8a9c2f8499fa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:55.114724 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b889b27d-7144-40cc-9503-8a9c2f8499fa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:55.256161 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b889b27d-7144-40cc-9503-8a9c2f8499fa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:55.263976 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b889b27d-7144-40cc-9503-8a9c2f8499fa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1755 microversion: 2.1 time: 0.162058 Jul 12 17:30:55.264535 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 301/573] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:55 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:55.275363 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-08193924-6ded-454f-9113-6cedc0f46422 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:55.275997 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-08193924-6ded-454f-9113-6cedc0f46422 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:55.282533 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08193924-6ded-454f-9113-6cedc0f46422 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:55.282988 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08193924-6ded-454f-9113-6cedc0f46422 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:55.283759 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08193924-6ded-454f-9113-6cedc0f46422 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:55.284770 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08193924-6ded-454f-9113-6cedc0f46422 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:55.408240 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-08193924-6ded-454f-9113-6cedc0f46422 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:55.416562 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-08193924-6ded-454f-9113-6cedc0f46422 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:55.418088 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-08193924-6ded-454f-9113-6cedc0f46422 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:55.419225 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-08193924-6ded-454f-9113-6cedc0f46422 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1746 microversion: 2.20 time: 0.147772 Jul 12 17:30:55.419781 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 273/574] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:30:55 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1746 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:30:56.280387 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5c925559-83d8-400d-a328-029c3ea8865e tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:56.280993 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5c925559-83d8-400d-a328-029c3ea8865e tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:56.286976 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5c925559-83d8-400d-a328-029c3ea8865e tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:56.287416 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5c925559-83d8-400d-a328-029c3ea8865e tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:56.288160 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5c925559-83d8-400d-a328-029c3ea8865e tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:56.288584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5c925559-83d8-400d-a328-029c3ea8865e tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:56.427244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5c925559-83d8-400d-a328-029c3ea8865e tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:56.435020 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5c925559-83d8-400d-a328-029c3ea8865e tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1755 microversion: 2.1 time: 0.158495 Jul 12 17:30:56.435570 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 302/575] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:56 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:56.437361 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-855c3f1d-5ca6-4c6e-a79c-8490c5fb0efc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:56.438066 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-855c3f1d-5ca6-4c6e-a79c-8490c5fb0efc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:56.440486 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:30:56.446048 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-855c3f1d-5ca6-4c6e-a79c-8490c5fb0efc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:56.446497 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-855c3f1d-5ca6-4c6e-a79c-8490c5fb0efc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:56.447267 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-855c3f1d-5ca6-4c6e-a79c-8490c5fb0efc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:56.447705 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-855c3f1d-5ca6-4c6e-a79c-8490c5fb0efc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:56.577044 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-855c3f1d-5ca6-4c6e-a79c-8490c5fb0efc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:56.584845 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-855c3f1d-5ca6-4c6e-a79c-8490c5fb0efc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:56.586381 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-855c3f1d-5ca6-4c6e-a79c-8490c5fb0efc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:56.587512 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-855c3f1d-5ca6-4c6e-a79c-8490c5fb0efc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1746 microversion: 2.20 time: 0.154162 Jul 12 17:30:56.588068 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 274/576] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:30:56 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:30:57.452159 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c39f0200-dd47-4dc2-b83c-6013f80959e3 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:57.452785 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c39f0200-dd47-4dc2-b83c-6013f80959e3 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:57.456047 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=51 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:30:57.461368 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c39f0200-dd47-4dc2-b83c-6013f80959e3 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:57.462108 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c39f0200-dd47-4dc2-b83c-6013f80959e3 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:57.462880 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c39f0200-dd47-4dc2-b83c-6013f80959e3 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:57.463515 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c39f0200-dd47-4dc2-b83c-6013f80959e3 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:57.605136 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7a18f80b-c965-4f8f-83a4-562e95ce7e18 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:57.605940 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7a18f80b-c965-4f8f-83a4-562e95ce7e18 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:57.613017 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7a18f80b-c965-4f8f-83a4-562e95ce7e18 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:57.616609 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c39f0200-dd47-4dc2-b83c-6013f80959e3 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:57.620461 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7a18f80b-c965-4f8f-83a4-562e95ce7e18 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:57.621473 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7a18f80b-c965-4f8f-83a4-562e95ce7e18 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:57.622557 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7a18f80b-c965-4f8f-83a4-562e95ce7e18 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:57.625617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c39f0200-dd47-4dc2-b83c-6013f80959e3 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1755 microversion: 2.1 time: 0.177263 Jul 12 17:30:57.626310 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 303/577] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:57 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:57.850207 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7a18f80b-c965-4f8f-83a4-562e95ce7e18 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:57.866010 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7a18f80b-c965-4f8f-83a4-562e95ce7e18 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:57.868554 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7a18f80b-c965-4f8f-83a4-562e95ce7e18 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:57.870409 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7a18f80b-c965-4f8f-83a4-562e95ce7e18 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1741 microversion: 2.20 time: 0.269147 Jul 12 17:30:57.878639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 275/578] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:30:57 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1741 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:30:58.644554 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-73fafee4-3cfe-4771-bab4-cefbdcd359e9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:58.646014 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-73fafee4-3cfe-4771-bab4-cefbdcd359e9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:58.652487 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-73fafee4-3cfe-4771-bab4-cefbdcd359e9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:58.653010 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-73fafee4-3cfe-4771-bab4-cefbdcd359e9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:58.653833 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-73fafee4-3cfe-4771-bab4-cefbdcd359e9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:58.654413 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-73fafee4-3cfe-4771-bab4-cefbdcd359e9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:58.826951 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-73fafee4-3cfe-4771-bab4-cefbdcd359e9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:58.836480 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-73fafee4-3cfe-4771-bab4-cefbdcd359e9 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1755 microversion: 2.1 time: 0.195960 Jul 12 17:30:58.837158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 304/579] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:58 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1755 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:30:58.888992 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b7c3851a-f933-4b43-b289-5d97d53d8a4c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:58.889850 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b7c3851a-f933-4b43-b289-5d97d53d8a4c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:58.898959 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b7c3851a-f933-4b43-b289-5d97d53d8a4c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:58.899890 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b7c3851a-f933-4b43-b289-5d97d53d8a4c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:58.900723 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b7c3851a-f933-4b43-b289-5d97d53d8a4c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:58.901373 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b7c3851a-f933-4b43-b289-5d97d53d8a4c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:59.039271 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b7c3851a-f933-4b43-b289-5d97d53d8a4c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:59.050036 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b7c3851a-f933-4b43-b289-5d97d53d8a4c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:59.051567 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b7c3851a-f933-4b43-b289-5d97d53d8a4c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:30:59.052726 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b7c3851a-f933-4b43-b289-5d97d53d8a4c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1741 microversion: 2.20 time: 0.167510 Jul 12 17:30:59.053281 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 276/580] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:30:58 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:30:59.853775 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bcb410c0-b87b-418e-bf03-8696b3db9b10 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:30:59.854574 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bcb410c0-b87b-418e-bf03-8696b3db9b10 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:30:59.861116 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bcb410c0-b87b-418e-bf03-8696b3db9b10 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:59.861906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bcb410c0-b87b-418e-bf03-8696b3db9b10 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:30:59.863056 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bcb410c0-b87b-418e-bf03-8696b3db9b10 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:30:59.863767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bcb410c0-b87b-418e-bf03-8696b3db9b10 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:00.026097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bcb410c0-b87b-418e-bf03-8696b3db9b10 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:00.034615 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bcb410c0-b87b-418e-bf03-8696b3db9b10 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1755 microversion: 2.1 time: 0.184279 Jul 12 17:31:00.035579 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 305/581] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:30:59 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:00.071651 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0968168c-e3ee-4553-9a1b-8bfef6991f73 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:00.072404 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0968168c-e3ee-4553-9a1b-8bfef6991f73 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:00.078974 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0968168c-e3ee-4553-9a1b-8bfef6991f73 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:00.081495 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0968168c-e3ee-4553-9a1b-8bfef6991f73 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:00.081495 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0968168c-e3ee-4553-9a1b-8bfef6991f73 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:00.081495 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0968168c-e3ee-4553-9a1b-8bfef6991f73 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:00.218649 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0968168c-e3ee-4553-9a1b-8bfef6991f73 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:00.227769 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0968168c-e3ee-4553-9a1b-8bfef6991f73 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:00.229840 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0968168c-e3ee-4553-9a1b-8bfef6991f73 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:00.231223 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0968168c-e3ee-4553-9a1b-8bfef6991f73 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1741 microversion: 2.20 time: 0.163834 Jul 12 17:31:00.242772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 277/582] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:00 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:31:01.052705 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-20294ac9-1b2d-4614-80cd-ea93ae00a0b2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:01.053312 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-20294ac9-1b2d-4614-80cd-ea93ae00a0b2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:01.060197 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-20294ac9-1b2d-4614-80cd-ea93ae00a0b2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:01.060638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-20294ac9-1b2d-4614-80cd-ea93ae00a0b2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:01.061406 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-20294ac9-1b2d-4614-80cd-ea93ae00a0b2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:01.061877 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-20294ac9-1b2d-4614-80cd-ea93ae00a0b2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:01.227590 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-20294ac9-1b2d-4614-80cd-ea93ae00a0b2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:01.236212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-20294ac9-1b2d-4614-80cd-ea93ae00a0b2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1755 microversion: 2.1 time: 0.187340 Jul 12 17:31:01.237456 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 306/583] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:01 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:01.250209 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-07e99a3b-fea6-445e-b18d-9b3a1f6ceb4d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:01.251023 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-07e99a3b-fea6-445e-b18d-9b3a1f6ceb4d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:01.259056 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-07e99a3b-fea6-445e-b18d-9b3a1f6ceb4d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:01.259586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-07e99a3b-fea6-445e-b18d-9b3a1f6ceb4d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:01.260486 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-07e99a3b-fea6-445e-b18d-9b3a1f6ceb4d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:01.260959 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-07e99a3b-fea6-445e-b18d-9b3a1f6ceb4d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:01.402088 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-07e99a3b-fea6-445e-b18d-9b3a1f6ceb4d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:01.412067 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-07e99a3b-fea6-445e-b18d-9b3a1f6ceb4d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:01.413612 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-07e99a3b-fea6-445e-b18d-9b3a1f6ceb4d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:01.414824 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-07e99a3b-fea6-445e-b18d-9b3a1f6ceb4d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1741 microversion: 2.20 time: 0.168958 Jul 12 17:31:01.415557 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 278/584] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:01 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:02.253985 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ab7174d8-35b6-464f-9f6a-67294a9204aa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:02.254733 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ab7174d8-35b6-464f-9f6a-67294a9204aa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:02.260803 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ab7174d8-35b6-464f-9f6a-67294a9204aa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:02.261258 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ab7174d8-35b6-464f-9f6a-67294a9204aa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:02.262099 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ab7174d8-35b6-464f-9f6a-67294a9204aa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:02.262499 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ab7174d8-35b6-464f-9f6a-67294a9204aa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:02.417325 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ab7174d8-35b6-464f-9f6a-67294a9204aa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:02.426288 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ab7174d8-35b6-464f-9f6a-67294a9204aa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1758 microversion: 2.1 time: 0.176211 Jul 12 17:31:02.426860 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 307/585] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:02 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:02.435464 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cd03194e-cb4e-4a00-942b-69465418ba04 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:02.436801 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-cd03194e-cb4e-4a00-942b-69465418ba04 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:02.444104 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cd03194e-cb4e-4a00-942b-69465418ba04 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:02.444807 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cd03194e-cb4e-4a00-942b-69465418ba04 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:02.445585 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cd03194e-cb4e-4a00-942b-69465418ba04 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:02.446045 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cd03194e-cb4e-4a00-942b-69465418ba04 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:02.591168 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cd03194e-cb4e-4a00-942b-69465418ba04 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:02.599380 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cd03194e-cb4e-4a00-942b-69465418ba04 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:02.600891 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-cd03194e-cb4e-4a00-942b-69465418ba04 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:02.602080 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-cd03194e-cb4e-4a00-942b-69465418ba04 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1741 microversion: 2.20 time: 0.171185 Jul 12 17:31:02.602808 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 279/586] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:02 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:03.620448 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fbfde5ea-e7ca-452e-bb6c-f1caefdefa9f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:03.621027 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fbfde5ea-e7ca-452e-bb6c-f1caefdefa9f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:03.627716 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fbfde5ea-e7ca-452e-bb6c-f1caefdefa9f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:03.628398 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fbfde5ea-e7ca-452e-bb6c-f1caefdefa9f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:03.629369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fbfde5ea-e7ca-452e-bb6c-f1caefdefa9f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:03.630163 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fbfde5ea-e7ca-452e-bb6c-f1caefdefa9f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:03.777282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fbfde5ea-e7ca-452e-bb6c-f1caefdefa9f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:03.787773 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fbfde5ea-e7ca-452e-bb6c-f1caefdefa9f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:03.789580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fbfde5ea-e7ca-452e-bb6c-f1caefdefa9f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:03.790978 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fbfde5ea-e7ca-452e-bb6c-f1caefdefa9f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1741 microversion: 2.20 time: 0.174550 Jul 12 17:31:03.791529 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 308/587] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:03 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:04.551698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-23a042b6-4628-4d52-ba9c-e7b912678599 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5e21b48-a191-47c9-8d07-b5e0dddde571"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:04.552814 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-23a042b6-4628-4d52-ba9c-e7b912678599 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:04.558960 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-23a042b6-4628-4d52-ba9c-e7b912678599 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:04.559594 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-23a042b6-4628-4d52-ba9c-e7b912678599 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:04.560259 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-23a042b6-4628-4d52-ba9c-e7b912678599 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:04.560563 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-23a042b6-4628-4d52-ba9c-e7b912678599 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:04.813466 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-26f6acd0-041e-41ab-9486-f94f54e6c236 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:04.814840 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-26f6acd0-041e-41ab-9486-f94f54e6c236 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:04.821660 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-26f6acd0-041e-41ab-9486-f94f54e6c236 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:04.822427 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-26f6acd0-041e-41ab-9486-f94f54e6c236 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:04.823418 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-26f6acd0-041e-41ab-9486-f94f54e6c236 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:04.824254 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-26f6acd0-041e-41ab-9486-f94f54e6c236 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:04.883421 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-23a042b6-4628-4d52-ba9c-e7b912678599 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "POST /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.453260 Jul 12 17:31:04.884331 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 280/588] 10.222.0.62 () {60 vars in 1322 bytes} [Tue Jul 12 17:31:04 2022] POST /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9/os-volume_attachments => generated 194 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:31:04.999372 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-26f6acd0-041e-41ab-9486-f94f54e6c236 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:05.008631 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-26f6acd0-041e-41ab-9486-f94f54e6c236 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:05.011116 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-26f6acd0-041e-41ab-9486-f94f54e6c236 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:05.012474 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-26f6acd0-041e-41ab-9486-f94f54e6c236 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1741 microversion: 2.20 time: 0.202795 Jul 12 17:31:05.013024 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 309/589] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:04 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1741 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:05.631458 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:31:05.632815 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Tue Jul 12 17:31:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:31:06.032742 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5d9b5852-9cc4-44b9-b112-e69900b51abe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:06.033452 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5d9b5852-9cc4-44b9-b112-e69900b51abe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:06.040587 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5d9b5852-9cc4-44b9-b112-e69900b51abe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:06.041319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5d9b5852-9cc4-44b9-b112-e69900b51abe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:06.044121 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5d9b5852-9cc4-44b9-b112-e69900b51abe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:06.044121 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5d9b5852-9cc4-44b9-b112-e69900b51abe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:06.192207 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5d9b5852-9cc4-44b9-b112-e69900b51abe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:06.200530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5d9b5852-9cc4-44b9-b112-e69900b51abe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:06.203591 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5d9b5852-9cc4-44b9-b112-e69900b51abe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:06.206184 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5d9b5852-9cc4-44b9-b112-e69900b51abe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1741 microversion: 2.20 time: 0.177603 Jul 12 17:31:06.206749 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 281/590] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:06 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:31:07.224757 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e17d8b8e-eb6c-444e-83b0-5d854f5e64fb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:07.225366 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e17d8b8e-eb6c-444e-83b0-5d854f5e64fb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:07.231540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e17d8b8e-eb6c-444e-83b0-5d854f5e64fb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:07.232014 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e17d8b8e-eb6c-444e-83b0-5d854f5e64fb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:07.232771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e17d8b8e-eb6c-444e-83b0-5d854f5e64fb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:07.233201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e17d8b8e-eb6c-444e-83b0-5d854f5e64fb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:07.364031 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e17d8b8e-eb6c-444e-83b0-5d854f5e64fb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:07.371789 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e17d8b8e-eb6c-444e-83b0-5d854f5e64fb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:07.373292 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e17d8b8e-eb6c-444e-83b0-5d854f5e64fb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:07.374463 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e17d8b8e-eb6c-444e-83b0-5d854f5e64fb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1741 microversion: 2.20 time: 0.154132 Jul 12 17:31:07.375006 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 310/591] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:07 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:08.392181 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f4f2ab62-0bd5-4964-8c8c-4c8d90dbb7c2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:08.392789 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f4f2ab62-0bd5-4964-8c8c-4c8d90dbb7c2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:08.399312 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f4f2ab62-0bd5-4964-8c8c-4c8d90dbb7c2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:08.399764 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f4f2ab62-0bd5-4964-8c8c-4c8d90dbb7c2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:08.400525 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f4f2ab62-0bd5-4964-8c8c-4c8d90dbb7c2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:08.400959 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f4f2ab62-0bd5-4964-8c8c-4c8d90dbb7c2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:08.525909 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f4f2ab62-0bd5-4964-8c8c-4c8d90dbb7c2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:08.534445 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f4f2ab62-0bd5-4964-8c8c-4c8d90dbb7c2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:08.535966 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f4f2ab62-0bd5-4964-8c8c-4c8d90dbb7c2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:08.537109 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f4f2ab62-0bd5-4964-8c8c-4c8d90dbb7c2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1723 microversion: 2.20 time: 0.148797 Jul 12 17:31:08.537660 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 282/592] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:08 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:09.554569 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-856bcdce-c957-44f1-8eea-8f113df9fe0d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:09.555191 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-856bcdce-c957-44f1-8eea-8f113df9fe0d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:09.561107 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-856bcdce-c957-44f1-8eea-8f113df9fe0d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:09.561548 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-856bcdce-c957-44f1-8eea-8f113df9fe0d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:09.562320 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-856bcdce-c957-44f1-8eea-8f113df9fe0d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:09.562749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-856bcdce-c957-44f1-8eea-8f113df9fe0d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:09.566629 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:09.688466 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-856bcdce-c957-44f1-8eea-8f113df9fe0d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:09.696433 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-856bcdce-c957-44f1-8eea-8f113df9fe0d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:09.697958 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-856bcdce-c957-44f1-8eea-8f113df9fe0d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:09.699131 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-856bcdce-c957-44f1-8eea-8f113df9fe0d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1723 microversion: 2.20 time: 0.148430 Jul 12 17:31:09.699667 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 311/593] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:09 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:10.717187 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c19d6fbe-835b-49e0-95ad-f2ce9cb33b59 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:10.717810 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c19d6fbe-835b-49e0-95ad-f2ce9cb33b59 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:10.724802 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c19d6fbe-835b-49e0-95ad-f2ce9cb33b59 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:10.725253 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c19d6fbe-835b-49e0-95ad-f2ce9cb33b59 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:10.726048 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c19d6fbe-835b-49e0-95ad-f2ce9cb33b59 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:10.726488 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c19d6fbe-835b-49e0-95ad-f2ce9cb33b59 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:10.745117 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:10.858308 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c19d6fbe-835b-49e0-95ad-f2ce9cb33b59 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:10.866698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c19d6fbe-835b-49e0-95ad-f2ce9cb33b59 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:10.868197 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c19d6fbe-835b-49e0-95ad-f2ce9cb33b59 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:10.869331 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c19d6fbe-835b-49e0-95ad-f2ce9cb33b59 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1666 microversion: 2.20 time: 0.156157 Jul 12 17:31:10.869913 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 283/594] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:10 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1666 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:10.886595 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-07432232-1cf9-4672-9aeb-fd437b78bfd7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d5130ef-e7a4-4d52-9737-ed6938a6d3f2"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:10.887726 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-07432232-1cf9-4672-9aeb-fd437b78bfd7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:10.893852 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-07432232-1cf9-4672-9aeb-fd437b78bfd7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:10.894297 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-07432232-1cf9-4672-9aeb-fd437b78bfd7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:10.895047 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-07432232-1cf9-4672-9aeb-fd437b78bfd7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:10.895477 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-07432232-1cf9-4672-9aeb-fd437b78bfd7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:11.164408 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-07432232-1cf9-4672-9aeb-fd437b78bfd7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "POST /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.281723 Jul 12 17:31:11.165003 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 312/595] 10.222.0.62 () {62 vars in 1363 bytes} [Tue Jul 12 17:31:10 2022] POST /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/os-volume_attachments => generated 188 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:31:11.276888 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a772cddf-034b-4af4-86f9-fe00e8bf77f0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:11.277462 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a772cddf-034b-4af4-86f9-fe00e8bf77f0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:11.283347 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a772cddf-034b-4af4-86f9-fe00e8bf77f0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:11.284539 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a772cddf-034b-4af4-86f9-fe00e8bf77f0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:11.285316 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a772cddf-034b-4af4-86f9-fe00e8bf77f0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:11.285777 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a772cddf-034b-4af4-86f9-fe00e8bf77f0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:11.417258 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a772cddf-034b-4af4-86f9-fe00e8bf77f0 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "POST /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/action" status: 202 len: 0 microversion: 2.20 time: 0.144175 Jul 12 17:31:11.417918 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 284/596] 10.222.0.62 () {62 vars in 1318 bytes} [Tue Jul 12 17:31:11 2022] POST /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:31:11.425929 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4fbffa0f-9db2-4f90-a485-cd86c99193bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:11.426536 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4fbffa0f-9db2-4f90-a485-cd86c99193bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:11.432739 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4fbffa0f-9db2-4f90-a485-cd86c99193bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:11.433188 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4fbffa0f-9db2-4f90-a485-cd86c99193bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:11.434005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4fbffa0f-9db2-4f90-a485-cd86c99193bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:11.434438 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4fbffa0f-9db2-4f90-a485-cd86c99193bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:11.568498 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4fbffa0f-9db2-4f90-a485-cd86c99193bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:11.577369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4fbffa0f-9db2-4f90-a485-cd86c99193bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:11.578841 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4fbffa0f-9db2-4f90-a485-cd86c99193bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:11.579940 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4fbffa0f-9db2-4f90-a485-cd86c99193bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1752 microversion: 2.20 time: 0.157961 Jul 12 17:31:11.580490 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 313/597] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:11 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:11.806262 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-ac946d53-ac3c-4f8d-bcd2-dd5211768c6e req-b127fbc6-f46b-4392-9d9f-022fcc1e215b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b5e50f-5079-438b-ac33-67623b4428f5", "name": "network-vif-unplugged", "status": "completed", "tag": "e0dd8828-dbc7-4d01-9d3f-ee997fb3d5ce"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:11.814642 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-ac946d53-ac3c-4f8d-bcd2-dd5211768c6e req-b127fbc6-f46b-4392-9d9f-022fcc1e215b service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:11.815629 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-ac946d53-ac3c-4f8d-bcd2-dd5211768c6e req-b127fbc6-f46b-4392-9d9f-022fcc1e215b service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:11.827542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.compute.server_external_events [req-ac946d53-ac3c-4f8d-bcd2-dd5211768c6e req-b127fbc6-f46b-4392-9d9f-022fcc1e215b service nova] Unable to find a host for instance 48b5e50f-5079-438b-ac33-67623b4428f5. Dropping event network-vif-unplugged {{(pid=117939) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 12 17:31:11.828411 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-ac946d53-ac3c-4f8d-bcd2-dd5211768c6e req-b127fbc6-f46b-4392-9d9f-022fcc1e215b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026010 Jul 12 17:31:11.828996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 285/598] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 12 17:31:12.394615 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8844c53a-34d3-4c57-8f7b-4b5e0d6e703b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:12.395632 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8844c53a-34d3-4c57-8f7b-4b5e0d6e703b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:12.401533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8844c53a-34d3-4c57-8f7b-4b5e0d6e703b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:12.402022 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8844c53a-34d3-4c57-8f7b-4b5e0d6e703b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:12.402781 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8844c53a-34d3-4c57-8f7b-4b5e0d6e703b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:12.403225 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8844c53a-34d3-4c57-8f7b-4b5e0d6e703b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:12.427962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-8844c53a-34d3-4c57-8f7b-4b5e0d6e703b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lazy-loading 'flavor' on Instance uuid 0e5af452-8518-42e8-b587-1d1fe57554c9 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:31:12.554017 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8844c53a-34d3-4c57-8f7b-4b5e0d6e703b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "POST /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9/action" status: 200 len: 32 microversion: 2.1 time: 0.163271 Jul 12 17:31:12.554842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 314/599] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Jul 12 17:31:12 2022] POST /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 17:31:12.564442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-54c93a3a-bb8a-4e33-aba6-4d77378be0a2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:12.565331 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-54c93a3a-bb8a-4e33-aba6-4d77378be0a2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:12.571702 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-54c93a3a-bb8a-4e33-aba6-4d77378be0a2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:12.572231 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-54c93a3a-bb8a-4e33-aba6-4d77378be0a2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:12.573125 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-54c93a3a-bb8a-4e33-aba6-4d77378be0a2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:12.573560 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-54c93a3a-bb8a-4e33-aba6-4d77378be0a2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:12.599818 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9d4003f6-f239-492c-8d92-9893ad87c9c7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:12.600624 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9d4003f6-f239-492c-8d92-9893ad87c9c7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:12.606868 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9d4003f6-f239-492c-8d92-9893ad87c9c7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:12.607316 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9d4003f6-f239-492c-8d92-9893ad87c9c7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:12.608080 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9d4003f6-f239-492c-8d92-9893ad87c9c7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:12.608513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9d4003f6-f239-492c-8d92-9893ad87c9c7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:12.868718 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-54c93a3a-bb8a-4e33-aba6-4d77378be0a2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:12.877350 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-54c93a3a-bb8a-4e33-aba6-4d77378be0a2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1736 microversion: 2.1 time: 0.316947 Jul 12 17:31:12.878449 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 286/600] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:12 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1736 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:12.890042 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9d4003f6-f239-492c-8d92-9893ad87c9c7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:12.898903 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9d4003f6-f239-492c-8d92-9893ad87c9c7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:12.900401 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9d4003f6-f239-492c-8d92-9893ad87c9c7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:12.901538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9d4003f6-f239-492c-8d92-9893ad87c9c7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1754 microversion: 2.20 time: 0.306574 Jul 12 17:31:12.902121 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 315/601] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:12 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1754 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:31:13.340583 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:31:13.340798 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Tue Jul 12 17:31:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:31:13.895314 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5084a948-1382-443c-9820-64b059dc859a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:13.895945 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5084a948-1382-443c-9820-64b059dc859a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:13.902919 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5084a948-1382-443c-9820-64b059dc859a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:13.903393 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5084a948-1382-443c-9820-64b059dc859a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:13.904152 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5084a948-1382-443c-9820-64b059dc859a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:13.904588 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5084a948-1382-443c-9820-64b059dc859a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:13.920036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7e780b23-7b34-4fa0-a4f6-4a16bd8c7d77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:13.920731 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7e780b23-7b34-4fa0-a4f6-4a16bd8c7d77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:13.927239 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7e780b23-7b34-4fa0-a4f6-4a16bd8c7d77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:13.927840 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7e780b23-7b34-4fa0-a4f6-4a16bd8c7d77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:13.928430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7e780b23-7b34-4fa0-a4f6-4a16bd8c7d77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:13.928853 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7e780b23-7b34-4fa0-a4f6-4a16bd8c7d77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:14.103938 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5084a948-1382-443c-9820-64b059dc859a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:14.107965 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7e780b23-7b34-4fa0-a4f6-4a16bd8c7d77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:14.111976 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5084a948-1382-443c-9820-64b059dc859a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1736 microversion: 2.1 time: 0.220631 Jul 12 17:31:14.121325 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 287/602] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:13 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:14.121494 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7e780b23-7b34-4fa0-a4f6-4a16bd8c7d77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:14.121494 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7e780b23-7b34-4fa0-a4f6-4a16bd8c7d77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:14.121494 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7e780b23-7b34-4fa0-a4f6-4a16bd8c7d77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.202903 Jul 12 17:31:14.121880 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 316/603] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:13 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:31:15.128786 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-08b5d6c1-d6d6-42f0-8bc6-091480149d66 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:15.129368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-08b5d6c1-d6d6-42f0-8bc6-091480149d66 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:15.135947 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08b5d6c1-d6d6-42f0-8bc6-091480149d66 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:15.136401 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08b5d6c1-d6d6-42f0-8bc6-091480149d66 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:15.136744 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fa62f20c-8995-47d2-a5a2-4a0556eab316 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:15.137157 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08b5d6c1-d6d6-42f0-8bc6-091480149d66 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:15.137356 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fa62f20c-8995-47d2-a5a2-4a0556eab316 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:15.137581 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08b5d6c1-d6d6-42f0-8bc6-091480149d66 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:15.143300 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fa62f20c-8995-47d2-a5a2-4a0556eab316 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:15.143751 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fa62f20c-8995-47d2-a5a2-4a0556eab316 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:15.144515 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fa62f20c-8995-47d2-a5a2-4a0556eab316 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:15.144953 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fa62f20c-8995-47d2-a5a2-4a0556eab316 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:15.332533 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-08b5d6c1-d6d6-42f0-8bc6-091480149d66 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:15.340240 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fa62f20c-8995-47d2-a5a2-4a0556eab316 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:15.349530 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fa62f20c-8995-47d2-a5a2-4a0556eab316 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:15.351072 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fa62f20c-8995-47d2-a5a2-4a0556eab316 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:15.352229 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fa62f20c-8995-47d2-a5a2-4a0556eab316 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.219346 Jul 12 17:31:15.353082 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 317/604] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:15 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:31:15.355803 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-08b5d6c1-d6d6-42f0-8bc6-091480149d66 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1736 microversion: 2.1 time: 0.230733 Jul 12 17:31:15.356452 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 288/605] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:15 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:16.371954 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ff759b8d-3007-45b7-961f-d9dbf0a5cfb7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:16.372540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ff759b8d-3007-45b7-961f-d9dbf0a5cfb7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:16.374727 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-76fd79b9-13be-40b3-89d6-84704a623c70 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:16.376286 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-76fd79b9-13be-40b3-89d6-84704a623c70 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:16.379427 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ff759b8d-3007-45b7-961f-d9dbf0a5cfb7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:16.379881 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ff759b8d-3007-45b7-961f-d9dbf0a5cfb7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:16.380659 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ff759b8d-3007-45b7-961f-d9dbf0a5cfb7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:16.381092 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ff759b8d-3007-45b7-961f-d9dbf0a5cfb7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:16.384127 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-76fd79b9-13be-40b3-89d6-84704a623c70 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:16.384647 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-76fd79b9-13be-40b3-89d6-84704a623c70 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:16.385606 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-76fd79b9-13be-40b3-89d6-84704a623c70 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:16.386225 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-76fd79b9-13be-40b3-89d6-84704a623c70 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:16.586899 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-76fd79b9-13be-40b3-89d6-84704a623c70 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:16.594737 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-76fd79b9-13be-40b3-89d6-84704a623c70 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1736 microversion: 2.1 time: 0.225018 Jul 12 17:31:16.595299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 289/606] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:16 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:31:16.612912 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ff759b8d-3007-45b7-961f-d9dbf0a5cfb7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:16.621201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ff759b8d-3007-45b7-961f-d9dbf0a5cfb7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:16.622784 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ff759b8d-3007-45b7-961f-d9dbf0a5cfb7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:16.623874 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ff759b8d-3007-45b7-961f-d9dbf0a5cfb7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.255850 Jul 12 17:31:16.624424 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 318/607] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:16 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:17.612779 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ca9b2f57-30ee-45ca-93c4-dc36f4918f42 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:17.613467 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ca9b2f57-30ee-45ca-93c4-dc36f4918f42 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:17.621540 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ca9b2f57-30ee-45ca-93c4-dc36f4918f42 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:17.622614 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ca9b2f57-30ee-45ca-93c4-dc36f4918f42 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:17.623812 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ca9b2f57-30ee-45ca-93c4-dc36f4918f42 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:17.624344 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ca9b2f57-30ee-45ca-93c4-dc36f4918f42 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:17.642433 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-68413e7a-8326-4ee4-8929-03a7d22d1081 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:17.644276 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-68413e7a-8326-4ee4-8929-03a7d22d1081 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:17.650396 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68413e7a-8326-4ee4-8929-03a7d22d1081 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:17.650847 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68413e7a-8326-4ee4-8929-03a7d22d1081 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:17.651617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68413e7a-8326-4ee4-8929-03a7d22d1081 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:17.652051 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-68413e7a-8326-4ee4-8929-03a7d22d1081 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:17.851496 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ca9b2f57-30ee-45ca-93c4-dc36f4918f42 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:17.855123 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-68413e7a-8326-4ee4-8929-03a7d22d1081 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:17.863988 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ca9b2f57-30ee-45ca-93c4-dc36f4918f42 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1736 microversion: 2.1 time: 0.255240 Jul 12 17:31:17.866387 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-68413e7a-8326-4ee4-8929-03a7d22d1081 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:17.868329 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-68413e7a-8326-4ee4-8929-03a7d22d1081 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:17.870273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-68413e7a-8326-4ee4-8929-03a7d22d1081 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.231733 Jul 12 17:31:17.871391 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 319/608] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:17 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:31:17.872524 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 290/609] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:17 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1736 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:18.880841 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e6659d85-677a-4842-95b4-43864bbdb67a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:18.881427 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e6659d85-677a-4842-95b4-43864bbdb67a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:18.887646 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e6659d85-677a-4842-95b4-43864bbdb67a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:18.888049 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-49e9ad79-6608-4532-af20-07427f839203 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:18.888508 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e6659d85-677a-4842-95b4-43864bbdb67a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:18.888660 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-49e9ad79-6608-4532-af20-07427f839203 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:18.888809 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e6659d85-677a-4842-95b4-43864bbdb67a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:18.889246 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e6659d85-677a-4842-95b4-43864bbdb67a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:18.896130 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-49e9ad79-6608-4532-af20-07427f839203 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:18.896579 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-49e9ad79-6608-4532-af20-07427f839203 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:18.897353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-49e9ad79-6608-4532-af20-07427f839203 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:18.897821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-49e9ad79-6608-4532-af20-07427f839203 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:19.085952 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e6659d85-677a-4842-95b4-43864bbdb67a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:19.094351 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-49e9ad79-6608-4532-af20-07427f839203 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:19.104235 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-49e9ad79-6608-4532-af20-07427f839203 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:19.105125 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e6659d85-677a-4842-95b4-43864bbdb67a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1736 microversion: 2.1 time: 0.228548 Jul 12 17:31:19.105883 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 320/610] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:18 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:19.115797 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-49e9ad79-6608-4532-af20-07427f839203 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:19.115797 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-49e9ad79-6608-4532-af20-07427f839203 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.223653 Jul 12 17:31:19.122115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 291/611] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:18 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:31:20.122658 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7cd63c30-8b42-4380-b8e0-3c0433aaa0d9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:20.123506 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7cd63c30-8b42-4380-b8e0-3c0433aaa0d9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:20.129777 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7cd63c30-8b42-4380-b8e0-3c0433aaa0d9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:20.130226 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7cd63c30-8b42-4380-b8e0-3c0433aaa0d9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:20.130979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7cd63c30-8b42-4380-b8e0-3c0433aaa0d9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:20.131641 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7cd63c30-8b42-4380-b8e0-3c0433aaa0d9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:20.142144 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5508fe52-2ed8-4f49-82ed-168ed10433d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:20.142750 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5508fe52-2ed8-4f49-82ed-168ed10433d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:20.149672 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5508fe52-2ed8-4f49-82ed-168ed10433d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:20.150158 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5508fe52-2ed8-4f49-82ed-168ed10433d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:20.150924 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5508fe52-2ed8-4f49-82ed-168ed10433d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:20.151359 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5508fe52-2ed8-4f49-82ed-168ed10433d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:20.341713 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7cd63c30-8b42-4380-b8e0-3c0433aaa0d9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:20.343791 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7cd63c30-8b42-4380-b8e0-3c0433aaa0d9 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1736 microversion: 2.1 time: 0.224894 Jul 12 17:31:20.344685 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 321/612] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:20 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:20.351667 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5508fe52-2ed8-4f49-82ed-168ed10433d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:20.365999 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5508fe52-2ed8-4f49-82ed-168ed10433d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:20.367624 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5508fe52-2ed8-4f49-82ed-168ed10433d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:20.368887 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5508fe52-2ed8-4f49-82ed-168ed10433d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.230610 Jul 12 17:31:20.382437 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 292/613] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:20 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:31:21.361365 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-19917938-d369-46a0-9c91-ff89c279799c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:21.362049 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-19917938-d369-46a0-9c91-ff89c279799c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:21.368702 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-19917938-d369-46a0-9c91-ff89c279799c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:21.369148 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-19917938-d369-46a0-9c91-ff89c279799c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:21.369941 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-19917938-d369-46a0-9c91-ff89c279799c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:21.370374 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-19917938-d369-46a0-9c91-ff89c279799c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:21.402559 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-29367429-f0e4-43c2-9e73-8950c0c16200 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:21.403101 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-29367429-f0e4-43c2-9e73-8950c0c16200 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:21.410334 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-29367429-f0e4-43c2-9e73-8950c0c16200 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:21.410784 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-29367429-f0e4-43c2-9e73-8950c0c16200 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:21.411560 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-29367429-f0e4-43c2-9e73-8950c0c16200 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:21.411993 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-29367429-f0e4-43c2-9e73-8950c0c16200 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:21.580831 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-19917938-d369-46a0-9c91-ff89c279799c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:21.590682 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-19917938-d369-46a0-9c91-ff89c279799c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1736 microversion: 2.1 time: 0.233118 Jul 12 17:31:21.591589 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 322/614] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:21 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:21.604552 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-29367429-f0e4-43c2-9e73-8950c0c16200 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:21.613063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-29367429-f0e4-43c2-9e73-8950c0c16200 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:21.614540 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-29367429-f0e4-43c2-9e73-8950c0c16200 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:21.615682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-29367429-f0e4-43c2-9e73-8950c0c16200 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.217072 Jul 12 17:31:21.616228 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 293/615] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:21 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:22.608232 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a780af2e-6d87-47ef-8992-61caf9dd3359 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:22.608864 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a780af2e-6d87-47ef-8992-61caf9dd3359 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:22.615642 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a780af2e-6d87-47ef-8992-61caf9dd3359 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:22.616084 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a780af2e-6d87-47ef-8992-61caf9dd3359 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:22.616832 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a780af2e-6d87-47ef-8992-61caf9dd3359 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:22.617260 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a780af2e-6d87-47ef-8992-61caf9dd3359 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:22.621304 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:22.633189 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c111213e-79ed-42b8-9e12-faeb0dacf74e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:22.634843 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c111213e-79ed-42b8-9e12-faeb0dacf74e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:22.642087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c111213e-79ed-42b8-9e12-faeb0dacf74e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:22.642873 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c111213e-79ed-42b8-9e12-faeb0dacf74e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:22.644206 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c111213e-79ed-42b8-9e12-faeb0dacf74e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:22.645018 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c111213e-79ed-42b8-9e12-faeb0dacf74e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:22.839658 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a780af2e-6d87-47ef-8992-61caf9dd3359 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:22.848069 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a780af2e-6d87-47ef-8992-61caf9dd3359 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1736 microversion: 2.1 time: 0.243196 Jul 12 17:31:22.848642 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 323/616] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:22 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1736 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:22.851664 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c111213e-79ed-42b8-9e12-faeb0dacf74e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:22.860000 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c111213e-79ed-42b8-9e12-faeb0dacf74e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:22.861450 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c111213e-79ed-42b8-9e12-faeb0dacf74e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:22.862610 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c111213e-79ed-42b8-9e12-faeb0dacf74e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.233339 Jul 12 17:31:22.863839 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 294/617] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:22 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:23.866466 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-aed1abf8-d3b4-4d8d-9c64-8b6e7570270e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:23.867262 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-aed1abf8-d3b4-4d8d-9c64-8b6e7570270e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:23.873876 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aed1abf8-d3b4-4d8d-9c64-8b6e7570270e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:23.874500 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aed1abf8-d3b4-4d8d-9c64-8b6e7570270e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:23.875384 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aed1abf8-d3b4-4d8d-9c64-8b6e7570270e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:23.875898 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aed1abf8-d3b4-4d8d-9c64-8b6e7570270e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:23.881955 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-43150178-a032-44eb-ac61-e4fdafbee047 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:23.883332 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-43150178-a032-44eb-ac61-e4fdafbee047 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:23.891080 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-43150178-a032-44eb-ac61-e4fdafbee047 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:23.891888 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-43150178-a032-44eb-ac61-e4fdafbee047 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:23.893058 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-43150178-a032-44eb-ac61-e4fdafbee047 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:23.893499 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-43150178-a032-44eb-ac61-e4fdafbee047 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:24.077569 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-aed1abf8-d3b4-4d8d-9c64-8b6e7570270e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:24.084454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-43150178-a032-44eb-ac61-e4fdafbee047 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:24.085647 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-aed1abf8-d3b4-4d8d-9c64-8b6e7570270e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1736 microversion: 2.1 time: 0.224921 Jul 12 17:31:24.086368 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 324/618] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:23 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:24.093258 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-43150178-a032-44eb-ac61-e4fdafbee047 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:24.094821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-43150178-a032-44eb-ac61-e4fdafbee047 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:24.096007 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-43150178-a032-44eb-ac61-e4fdafbee047 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.219112 Jul 12 17:31:24.096775 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 295/619] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:23 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:31:25.103168 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b2a0a3a0-1f1b-4e21-b186-43624a12bfcc tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:25.103807 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b2a0a3a0-1f1b-4e21-b186-43624a12bfcc tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:25.109664 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b2a0a3a0-1f1b-4e21-b186-43624a12bfcc tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:25.110133 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b2a0a3a0-1f1b-4e21-b186-43624a12bfcc tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:25.110880 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b2a0a3a0-1f1b-4e21-b186-43624a12bfcc tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:25.111306 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b2a0a3a0-1f1b-4e21-b186-43624a12bfcc tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:25.114044 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1c75eca4-3dda-4a23-8955-c9fe2bae64d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:25.114657 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1c75eca4-3dda-4a23-8955-c9fe2bae64d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:25.121038 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c75eca4-3dda-4a23-8955-c9fe2bae64d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:25.121486 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c75eca4-3dda-4a23-8955-c9fe2bae64d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:25.122285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c75eca4-3dda-4a23-8955-c9fe2bae64d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:25.122724 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c75eca4-3dda-4a23-8955-c9fe2bae64d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:25.332095 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b2a0a3a0-1f1b-4e21-b186-43624a12bfcc tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:25.339138 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1c75eca4-3dda-4a23-8955-c9fe2bae64d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:25.340454 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b2a0a3a0-1f1b-4e21-b186-43624a12bfcc tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1736 microversion: 2.1 time: 0.241099 Jul 12 17:31:25.341024 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 325/620] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:25 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1736 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:25.347444 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1c75eca4-3dda-4a23-8955-c9fe2bae64d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:25.348949 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1c75eca4-3dda-4a23-8955-c9fe2bae64d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:25.350112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1c75eca4-3dda-4a23-8955-c9fe2bae64d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.240007 Jul 12 17:31:25.350647 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 296/621] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:25 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:31:26.358063 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d0f8c23e-97e2-42d3-9b96-e77b8785cdcb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:26.358840 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d0f8c23e-97e2-42d3-9b96-e77b8785cdcb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:26.369391 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-44ee0cd2-76e6-4aea-9e8f-b4f4c29d664a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:26.370204 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-44ee0cd2-76e6-4aea-9e8f-b4f4c29d664a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:26.383970 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-44ee0cd2-76e6-4aea-9e8f-b4f4c29d664a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:26.384432 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-44ee0cd2-76e6-4aea-9e8f-b4f4c29d664a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:26.385227 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-44ee0cd2-76e6-4aea-9e8f-b4f4c29d664a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:26.385984 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0f8c23e-97e2-42d3-9b96-e77b8785cdcb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:26.386563 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0f8c23e-97e2-42d3-9b96-e77b8785cdcb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:26.387364 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0f8c23e-97e2-42d3-9b96-e77b8785cdcb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:26.387772 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0f8c23e-97e2-42d3-9b96-e77b8785cdcb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:26.393253 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-44ee0cd2-76e6-4aea-9e8f-b4f4c29d664a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:26.592479 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d0f8c23e-97e2-42d3-9b96-e77b8785cdcb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:26.595483 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-44ee0cd2-76e6-4aea-9e8f-b4f4c29d664a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:26.600674 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d0f8c23e-97e2-42d3-9b96-e77b8785cdcb tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1736 microversion: 2.1 time: 0.246989 Jul 12 17:31:26.601335 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 326/622] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:26 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1736 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:26.603932 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-44ee0cd2-76e6-4aea-9e8f-b4f4c29d664a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:26.605434 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-44ee0cd2-76e6-4aea-9e8f-b4f4c29d664a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:26.606627 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-44ee0cd2-76e6-4aea-9e8f-b4f4c29d664a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.241961 Jul 12 17:31:26.607169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 297/623] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:26 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:27.617795 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c0f5a7e3-bd26-475a-af0f-2913ae5fa829 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:27.618420 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c0f5a7e3-bd26-475a-af0f-2913ae5fa829 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:27.620242 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=48 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:27.624571 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8d4b310a-efee-4959-aab2-f665e1aa1a1a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:27.625170 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8d4b310a-efee-4959-aab2-f665e1aa1a1a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:27.625590 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c0f5a7e3-bd26-475a-af0f-2913ae5fa829 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:27.626083 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c0f5a7e3-bd26-475a-af0f-2913ae5fa829 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:27.626857 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c0f5a7e3-bd26-475a-af0f-2913ae5fa829 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:27.627275 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c0f5a7e3-bd26-475a-af0f-2913ae5fa829 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:27.627437 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=50 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:27.632947 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8d4b310a-efee-4959-aab2-f665e1aa1a1a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:27.633428 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8d4b310a-efee-4959-aab2-f665e1aa1a1a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:27.634224 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8d4b310a-efee-4959-aab2-f665e1aa1a1a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:27.634663 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8d4b310a-efee-4959-aab2-f665e1aa1a1a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:27.820994 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c0f5a7e3-bd26-475a-af0f-2913ae5fa829 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:27.824180 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8d4b310a-efee-4959-aab2-f665e1aa1a1a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:27.828919 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c0f5a7e3-bd26-475a-af0f-2913ae5fa829 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1736 microversion: 2.1 time: 0.215001 Jul 12 17:31:27.829495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 327/624] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:27 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:27.833231 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8d4b310a-efee-4959-aab2-f665e1aa1a1a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:27.836412 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8d4b310a-efee-4959-aab2-f665e1aa1a1a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:27.836412 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8d4b310a-efee-4959-aab2-f665e1aa1a1a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.215466 Jul 12 17:31:27.836786 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 298/625] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:27 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:31:28.854044 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0f0615a7-f0f7-4037-b073-02d621cb92b0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:28.854670 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9e3d5239-a5af-4488-83fa-ee4add4a68b4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:28.854670 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9e3d5239-a5af-4488-83fa-ee4add4a68b4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:28.855134 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0f0615a7-f0f7-4037-b073-02d621cb92b0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:28.860948 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0f0615a7-f0f7-4037-b073-02d621cb92b0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:28.861113 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e3d5239-a5af-4488-83fa-ee4add4a68b4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:28.861398 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0f0615a7-f0f7-4037-b073-02d621cb92b0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:28.861518 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e3d5239-a5af-4488-83fa-ee4add4a68b4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:28.862207 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0f0615a7-f0f7-4037-b073-02d621cb92b0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:28.862335 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e3d5239-a5af-4488-83fa-ee4add4a68b4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:28.862676 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0f0615a7-f0f7-4037-b073-02d621cb92b0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:28.863362 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9e3d5239-a5af-4488-83fa-ee4add4a68b4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:29.058145 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9e3d5239-a5af-4488-83fa-ee4add4a68b4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:29.061192 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0f0615a7-f0f7-4037-b073-02d621cb92b0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:29.064562 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:29.067784 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9e3d5239-a5af-4488-83fa-ee4add4a68b4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:29.069540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9e3d5239-a5af-4488-83fa-ee4add4a68b4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:29.070203 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0f0615a7-f0f7-4037-b073-02d621cb92b0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1736 microversion: 2.1 time: 0.220085 Jul 12 17:31:29.070728 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9e3d5239-a5af-4488-83fa-ee4add4a68b4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.220653 Jul 12 17:31:29.070907 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 299/626] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:28 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:29.071268 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 328/627] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:28 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:30.087710 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a5979f9c-ebdb-454b-9988-47936020a826 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:30.088320 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a5979f9c-ebdb-454b-9988-47936020a826 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:30.088464 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-53638d52-84e3-42ea-bfc7-e87ae9a49a70 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:30.088945 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-53638d52-84e3-42ea-bfc7-e87ae9a49a70 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:30.095173 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5979f9c-ebdb-454b-9988-47936020a826 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:30.095319 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53638d52-84e3-42ea-bfc7-e87ae9a49a70 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:30.095618 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5979f9c-ebdb-454b-9988-47936020a826 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:30.095732 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53638d52-84e3-42ea-bfc7-e87ae9a49a70 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:30.096378 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5979f9c-ebdb-454b-9988-47936020a826 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:30.096494 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53638d52-84e3-42ea-bfc7-e87ae9a49a70 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:30.096809 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5979f9c-ebdb-454b-9988-47936020a826 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:30.097427 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53638d52-84e3-42ea-bfc7-e87ae9a49a70 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:30.288259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-53638d52-84e3-42ea-bfc7-e87ae9a49a70 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:30.292011 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a5979f9c-ebdb-454b-9988-47936020a826 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:30.296808 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-53638d52-84e3-42ea-bfc7-e87ae9a49a70 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:30.298341 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-53638d52-84e3-42ea-bfc7-e87ae9a49a70 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:30.299481 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-53638d52-84e3-42ea-bfc7-e87ae9a49a70 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.215198 Jul 12 17:31:30.299814 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a5979f9c-ebdb-454b-9988-47936020a826 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1736 microversion: 2.1 time: 0.216588 Jul 12 17:31:30.300791 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 329/628] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:30 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:31:30.305415 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 300/629] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:30 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:31.317044 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-48968a33-baca-45e0-a094-16ef10b943a3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:31.317666 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-48968a33-baca-45e0-a094-16ef10b943a3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:31.318480 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7608c462-5d6e-44ec-bcef-205793404f89 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:31.319356 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7608c462-5d6e-44ec-bcef-205793404f89 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:31.324075 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-48968a33-baca-45e0-a094-16ef10b943a3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:31.324529 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-48968a33-baca-45e0-a094-16ef10b943a3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:31.325288 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-48968a33-baca-45e0-a094-16ef10b943a3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:31.325747 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-48968a33-baca-45e0-a094-16ef10b943a3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:31.325886 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7608c462-5d6e-44ec-bcef-205793404f89 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:31.326330 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7608c462-5d6e-44ec-bcef-205793404f89 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:31.327120 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7608c462-5d6e-44ec-bcef-205793404f89 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:31.327554 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7608c462-5d6e-44ec-bcef-205793404f89 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:31.516650 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7608c462-5d6e-44ec-bcef-205793404f89 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:31.520483 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-48968a33-baca-45e0-a094-16ef10b943a3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:31.525064 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7608c462-5d6e-44ec-bcef-205793404f89 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:31.526594 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7608c462-5d6e-44ec-bcef-205793404f89 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:31.527738 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7608c462-5d6e-44ec-bcef-205793404f89 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.213777 Jul 12 17:31:31.528291 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-48968a33-baca-45e0-a094-16ef10b943a3 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1736 microversion: 2.1 time: 0.215830 Jul 12 17:31:31.528405 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 301/630] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:31 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:31:31.528844 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 330/631] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:31 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:32.545330 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8e819928-ea11-4724-b9f5-5120adbe96a8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:32.545930 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b475398b-7b61-444f-b151-b41592ad534f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:32.546302 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8e819928-ea11-4724-b9f5-5120adbe96a8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:32.546407 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b475398b-7b61-444f-b151-b41592ad534f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:32.552247 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b475398b-7b61-444f-b151-b41592ad534f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:32.552397 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8e819928-ea11-4724-b9f5-5120adbe96a8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:32.552690 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8e819928-ea11-4724-b9f5-5120adbe96a8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:32.552799 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b475398b-7b61-444f-b151-b41592ad534f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:32.553443 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8e819928-ea11-4724-b9f5-5120adbe96a8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:32.553545 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b475398b-7b61-444f-b151-b41592ad534f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:32.553907 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b475398b-7b61-444f-b151-b41592ad534f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:32.554005 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8e819928-ea11-4724-b9f5-5120adbe96a8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:32.747361 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8e819928-ea11-4724-b9f5-5120adbe96a8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:32.751717 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b475398b-7b61-444f-b151-b41592ad534f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:32.756231 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8e819928-ea11-4724-b9f5-5120adbe96a8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1736 microversion: 2.1 time: 0.214637 Jul 12 17:31:32.756806 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 302/632] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:32 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:32.760604 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b475398b-7b61-444f-b151-b41592ad534f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:32.762142 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b475398b-7b61-444f-b151-b41592ad534f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:32.763284 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b475398b-7b61-444f-b151-b41592ad534f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.221608 Jul 12 17:31:32.763830 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 331/633] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:32 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:31:33.773522 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c43c6996-0695-4287-95d9-bf3d32b3dfcf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:33.775478 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c43c6996-0695-4287-95d9-bf3d32b3dfcf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:33.780268 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0ef88675-211d-499e-8578-83361e6cef3e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:33.780868 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0ef88675-211d-499e-8578-83361e6cef3e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:33.782110 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c43c6996-0695-4287-95d9-bf3d32b3dfcf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:33.782559 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c43c6996-0695-4287-95d9-bf3d32b3dfcf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:33.783356 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c43c6996-0695-4287-95d9-bf3d32b3dfcf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:33.783791 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c43c6996-0695-4287-95d9-bf3d32b3dfcf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:33.787520 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0ef88675-211d-499e-8578-83361e6cef3e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:33.787958 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0ef88675-211d-499e-8578-83361e6cef3e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:33.788707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0ef88675-211d-499e-8578-83361e6cef3e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:33.789132 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0ef88675-211d-499e-8578-83361e6cef3e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:33.978903 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c43c6996-0695-4287-95d9-bf3d32b3dfcf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:33.981708 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0ef88675-211d-499e-8578-83361e6cef3e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:33.986861 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c43c6996-0695-4287-95d9-bf3d32b3dfcf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1736 microversion: 2.1 time: 0.217679 Jul 12 17:31:33.987425 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 303/634] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:33 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:33.990148 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0ef88675-211d-499e-8578-83361e6cef3e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:33.991636 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0ef88675-211d-499e-8578-83361e6cef3e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:33.992943 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0ef88675-211d-499e-8578-83361e6cef3e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.216316 Jul 12 17:31:33.993483 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 332/635] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:33 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:31:35.004115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2abd15ca-0c00-4ff8-8cbb-812af3ccc61f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:35.004723 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2abd15ca-0c00-4ff8-8cbb-812af3ccc61f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:35.011131 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-aebf9c65-407e-4723-828f-055df74389e2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:35.011587 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2abd15ca-0c00-4ff8-8cbb-812af3ccc61f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:35.011705 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2abd15ca-0c00-4ff8-8cbb-812af3ccc61f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:35.011858 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-aebf9c65-407e-4723-828f-055df74389e2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:35.012379 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2abd15ca-0c00-4ff8-8cbb-812af3ccc61f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:35.012812 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2abd15ca-0c00-4ff8-8cbb-812af3ccc61f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:35.017801 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aebf9c65-407e-4723-828f-055df74389e2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:35.018246 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aebf9c65-407e-4723-828f-055df74389e2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:35.019587 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aebf9c65-407e-4723-828f-055df74389e2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:35.020020 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aebf9c65-407e-4723-828f-055df74389e2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:35.202703 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2abd15ca-0c00-4ff8-8cbb-812af3ccc61f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:35.205809 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-aebf9c65-407e-4723-828f-055df74389e2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:35.211183 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2abd15ca-0c00-4ff8-8cbb-812af3ccc61f tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1736 microversion: 2.1 time: 0.210903 Jul 12 17:31:35.211753 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 304/636] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:34 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:35.214904 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-aebf9c65-407e-4723-828f-055df74389e2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:35.221244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-aebf9c65-407e-4723-828f-055df74389e2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:35.221244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-aebf9c65-407e-4723-828f-055df74389e2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.211210 Jul 12 17:31:35.221244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 333/637] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:35 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:36.228727 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-014a2779-4b8b-4b4a-9bce-0db0d04b9041 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:36.229357 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-014a2779-4b8b-4b4a-9bce-0db0d04b9041 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:36.235906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-014a2779-4b8b-4b4a-9bce-0db0d04b9041 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:36.236073 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9a1166a3-7e11-4175-b4af-92e7206b0766 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:36.236506 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-014a2779-4b8b-4b4a-9bce-0db0d04b9041 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:36.236613 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9a1166a3-7e11-4175-b4af-92e7206b0766 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:36.237108 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-014a2779-4b8b-4b4a-9bce-0db0d04b9041 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:36.238199 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-014a2779-4b8b-4b4a-9bce-0db0d04b9041 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:36.243095 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9a1166a3-7e11-4175-b4af-92e7206b0766 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:36.243486 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9a1166a3-7e11-4175-b4af-92e7206b0766 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:36.244236 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9a1166a3-7e11-4175-b4af-92e7206b0766 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:36.244660 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9a1166a3-7e11-4175-b4af-92e7206b0766 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:36.426991 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-014a2779-4b8b-4b4a-9bce-0db0d04b9041 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:36.434835 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-014a2779-4b8b-4b4a-9bce-0db0d04b9041 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1716 microversion: 2.1 time: 0.209908 Jul 12 17:31:36.435403 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 305/638] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:36 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1716 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:36.437989 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9a1166a3-7e11-4175-b4af-92e7206b0766 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:36.448886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9a1166a3-7e11-4175-b4af-92e7206b0766 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:36.450528 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9a1166a3-7e11-4175-b4af-92e7206b0766 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:36.451800 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9a1166a3-7e11-4175-b4af-92e7206b0766 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.219592 Jul 12 17:31:36.452612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 334/639] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:36 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:31:36.488819 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-db3b1466-ef7c-4298-978d-64eb9f8fd914 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:36.489320 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-db3b1466-ef7c-4298-978d-64eb9f8fd914 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:36.497275 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db3b1466-ef7c-4298-978d-64eb9f8fd914 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:36.497747 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db3b1466-ef7c-4298-978d-64eb9f8fd914 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:36.498634 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db3b1466-ef7c-4298-978d-64eb9f8fd914 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:36.499082 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db3b1466-ef7c-4298-978d-64eb9f8fd914 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:36.546131 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-fc2ef821-465c-490f-8eb6-275ef426b6b0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:36.546633 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-fc2ef821-465c-490f-8eb6-275ef426b6b0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:36.552487 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fc2ef821-465c-490f-8eb6-275ef426b6b0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:36.552936 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fc2ef821-465c-490f-8eb6-275ef426b6b0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:36.553716 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fc2ef821-465c-490f-8eb6-275ef426b6b0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:36.554161 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fc2ef821-465c-490f-8eb6-275ef426b6b0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:36.580249 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-fc2ef821-465c-490f-8eb6-275ef426b6b0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26/ips" status: 200 len: 151 microversion: 2.1 time: 0.143821 Jul 12 17:31:36.580808 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 306/640] 10.222.0.62 () {58 vars in 1247 bytes} [Tue Jul 12 17:31:36 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26/ips => generated 151 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:31:36.591311 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-16a7d87f-b470-4103-8a15-0fd0b614ac43 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d00ca24-3258-42fe-89c2-f8bca45db332"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:36.592430 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-16a7d87f-b470-4103-8a15-0fd0b614ac43 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:36.599002 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-16a7d87f-b470-4103-8a15-0fd0b614ac43 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:36.599659 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-16a7d87f-b470-4103-8a15-0fd0b614ac43 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:36.600426 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-16a7d87f-b470-4103-8a15-0fd0b614ac43 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:36.600861 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-16a7d87f-b470-4103-8a15-0fd0b614ac43 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:36.630818 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-db3b1466-ef7c-4298-978d-64eb9f8fd914 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] HTTP exception thrown: Cannot 'detach_volume' instance 0e5af452-8518-42e8-b587-1d1fe57554c9 while it is in vm_state rescued Jul 12 17:31:36.632429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-db3b1466-ef7c-4298-978d-64eb9f8fd914 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Request method failure captured: Jul 12 17:31:36.632429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9/os-volume_attachments/c5e21b48-a191-47c9-8d07-b5e0dddde571 HTTP/1.1 Jul 12 17:31:36.632429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:31:36.632429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:31:36.632429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:31:36.632429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:31:36.632429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:31:36.632429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:31:36.632429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:31:36.632429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:31:36.632429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza6rtSgQfpSEtZ33IwhEqpKxmMGz09pu5YbdTNTT6Fheask6iWh4UHUt4FI8V1LgyIrpYykgBodOOWWf2Mu8K7Zj7tYnj7ZacrJDVDubl2Llq3NDzasM5K4t3A3ipyRv-AeEDGWJXxr1RuzCzLapbei7evPQzraouwzSNqwP_LaByJ8 Jul 12 17:31:36.632429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:31:36.632429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:31:36.632429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:31:36.632429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:31:36.632429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:31:36.632429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:31:36.632429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: 13884af024db42bcb013e475df0a53f0 Jul 12 17:31:36.632429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-425710136 Jul 12 17:31:36.632429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:31:36.632429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:31:36.634220 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/13884af024db42bcb013e475df0a53f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/13884af024db42bcb013e475df0a53f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/13884af024db42bcb013e475df0a53f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_13884af024db42bcb013e475df0a53f0", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:31:36.634220 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-ServerRescueNegativeTestJSON-425710136 Jul 12 17:31:36.634220 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 13884af024db42bcb013e475df0a53f0 Jul 12 17:31:36.634220 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-425710136 Jul 12 17:31:36.634220 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-ServerRescueNegativeTestJSON-425710136-project Jul 12 17:31:36.634220 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:31:36.634220 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:31:36.634220 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: 35e0364ccc1d4992932e8483e3f1f9d6 Jul 12 17:31:36.634220 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-ServerRescueNegativeTestJSON-425710136-project Jul 12 17:31:36.634220 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:31:36.634220 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Cannot 'detach_volume' instance 0e5af452-8518-42e8-b587-1d1fe57554c9 while it is in vm_state rescued Jul 12 17:31:36.635467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'server_id': '0e5af452-8518-42e8-b587-1d1fe57554c9', 'id': 'c5e21b48-a191-47c9-8d07-b5e0dddde571'} Jul 12 17:31:36.635467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:31:36.635467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:31:36.635467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 12 17:31:36.635467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 12 17:31:36.635467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 17:31:36.635467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 17:31:36.635467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 17:31:36.635467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 17:31:36.635467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0e5af452-8518-42e8-b587-1d1fe57554c9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 12 17:31:36.635467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:31:36.635467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:31:36.635467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:31:36.635467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:31:36.635467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:31:36.635467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:31:36.635467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:31:36.635467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:31:36.635467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:31:36.635467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:31:36.636707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 12 17:31:36.636707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 17:31:36.636707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 17:31:36.636707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 17:31:36.636707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0e5af452-8518-42e8-b587-1d1fe57554c9 while it is in vm_state rescued Jul 12 17:31:36.636707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:31:36.636707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:31:36.636707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:31:36.636707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:31:36.636707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:31:36.636707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:31:36.636707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:31:36.636707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:31:36.636707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0e5af452-8518-42e8-b587-1d1fe57554c9 while it is in vm_state rescued Jul 12 17:31:36.636707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:31:36.636707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-db3b1466-ef7c-4298-978d-64eb9f8fd914 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Returning 409 to user: Cannot 'detach_volume' instance 0e5af452-8518-42e8-b587-1d1fe57554c9 while it is in vm_state rescued {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:31:36.638639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-db3b1466-ef7c-4298-978d-64eb9f8fd914 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9/os-volume_attachments/c5e21b48-a191-47c9-8d07-b5e0dddde571" status: 409 len: 152 microversion: 2.1 time: 0.149041 Jul 12 17:31:36.638639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 335/641] 10.222.0.62 () {58 vars in 1415 bytes} [Tue Jul 12 17:31:36 2022] DELETE /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9/os-volume_attachments/c5e21b48-a191-47c9-8d07-b5e0dddde571 => generated 152 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 12 17:31:36.642418 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1c0d42ff-3a70-4876-89ab-e848cd732f0e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:36.642948 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1c0d42ff-3a70-4876-89ab-e848cd732f0e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:36.650308 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1c0d42ff-3a70-4876-89ab-e848cd732f0e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:36.650456 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1c0d42ff-3a70-4876-89ab-e848cd732f0e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:36.651166 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1c0d42ff-3a70-4876-89ab-e848cd732f0e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:36.651600 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1c0d42ff-3a70-4876-89ab-e848cd732f0e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:36.678972 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-16a7d87f-b470-4103-8a15-0fd0b614ac43 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] HTTP exception thrown: Invalid volume: volume 5d00ca24-3258-42fe-89c2-f8bca45db332 is already attached to instances: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 Jul 12 17:31:36.680698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-16a7d87f-b470-4103-8a15-0fd0b614ac43 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Request method failure captured: Jul 12 17:31:36.680698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: POST /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26/os-volume_attachments HTTP/1.1 Jul 12 17:31:36.680698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:31:36.680698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:31:36.680698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:31:36.680698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 74 Jul 12 17:31:36.680698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:31:36.680698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:31:36.680698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:31:36.680698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:31:36.680698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza6s95YbmpHGEF6KuEgm1a_bLJ81FwTpSTIH7MTxyWuinNdKpad_B8P_UZWneUdxW68SGH3Srj8_vZq-CuSnlwKSv16guwMSxTDbOGQyNs0XrVu8KfhrnvEOXIz2ODhAC95eTPACdOrc6qWclLz7G-TtlizrY4gQ1jWkpckM6H1sbeY Jul 12 17:31:36.680698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:31:36.680698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:31:36.680698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:31:36.680698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:31:36.680698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:31:36.680698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:31:36.680698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:31:36.680698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:31:36.680698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:31:36.680698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:31:36.682290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4a4e837b171b4b4a9c2ad230cda53452", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:31:36.682290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:31:36.682290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:31:36.682290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:31:36.682290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:31:36.682290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:31:36.682290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:31:36.682290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: 38a74ebdd59a491386aedcdbd312b363 Jul 12 17:31:36.682290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:31:36.682290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Jul 12 17:31:36.682290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {"volumeAttachment": {"volumeId": "5d00ca24-3258-42fe-89c2-f8bca45db332"}} Jul 12 17:31:36.682290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:31:36.683780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Invalid volume: volume 5d00ca24-3258-42fe-89c2-f8bca45db332 is already attached to instances: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 Jul 12 17:31:36.683780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'server_id': '34d0b582-fd90-42a8-a0cf-9acd222b3d26', 'body': {'volumeAttachment': {'volumeId': '5d00ca24-3258-42fe-89c2-f8bca45db332'}}} Jul 12 17:31:36.683780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:31:36.683780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:31:36.683780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 17:31:36.683780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 17:31:36.683780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 17:31:36.683780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 17:31:36.683780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 17:31:36.683780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 17:31:36.683780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 17:31:36.683780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 17:31:36.683780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 17:31:36.683780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 17:31:36.683780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5d00ca24-3258-42fe-89c2-f8bca45db332 is already attached to instances: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 Jul 12 17:31:36.683780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:31:36.683780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:31:36.683780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:31:36.683780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:31:36.686055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:31:36.686055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:31:36.686055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:31:36.686055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:31:36.686055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:31:36.686055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:31:36.686055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 17:31:36.686055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:31:36.686055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 17:31:36.686055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:31:36.686055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 17:31:36.686055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:31:36.686055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 17:31:36.686055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 17:31:36.686055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5d00ca24-3258-42fe-89c2-f8bca45db332 is already attached to instances: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 Jul 12 17:31:36.686055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:31:36.686055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:31:36.686055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:31:36.686055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:31:36.686055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:31:36.687479 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:31:36.687479 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:31:36.687479 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:31:36.687479 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5d00ca24-3258-42fe-89c2-f8bca45db332 is already attached to instances: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 Jul 12 17:31:36.687479 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:31:36.687479 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-16a7d87f-b470-4103-8a15-0fd0b614ac43 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Returning 400 to user: Invalid volume: volume 5d00ca24-3258-42fe-89c2-f8bca45db332 is already attached to instances: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:31:36.687479 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-16a7d87f-b470-4103-8a15-0fd0b614ac43 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "POST /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094542 Jul 12 17:31:36.687479 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 307/642] 10.222.0.62 () {60 vars in 1322 bytes} [Tue Jul 12 17:31:36 2022] POST /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 12 17:31:36.690582 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a6981120-7642-4b3e-bfff-6579760aa106 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:36.691499 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a6981120-7642-4b3e-bfff-6579760aa106 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:36.697102 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a6981120-7642-4b3e-bfff-6579760aa106 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:36.697554 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a6981120-7642-4b3e-bfff-6579760aa106 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:36.698413 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a6981120-7642-4b3e-bfff-6579760aa106 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:36.698833 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a6981120-7642-4b3e-bfff-6579760aa106 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:36.720913 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1c0d42ff-3a70-4876-89ab-e848cd732f0e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "POST /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9/action" status: 202 len: 0 microversion: 2.1 time: 0.081922 Jul 12 17:31:36.721711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 336/643] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Jul 12 17:31:36 2022] POST /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:31:36.725831 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a6981120-7642-4b3e-bfff-6579760aa106 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Going to try to terminate instance {{(pid=117939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:31:36.731145 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0754d91e-a74d-4d83-8f1a-dca7b8b9be97 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:36.732279 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0754d91e-a74d-4d83-8f1a-dca7b8b9be97 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:36.738437 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0754d91e-a74d-4d83-8f1a-dca7b8b9be97 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:36.739100 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0754d91e-a74d-4d83-8f1a-dca7b8b9be97 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:36.740254 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0754d91e-a74d-4d83-8f1a-dca7b8b9be97 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:36.740741 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0754d91e-a74d-4d83-8f1a-dca7b8b9be97 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:36.826390 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a6981120-7642-4b3e-bfff-6579760aa106 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "DELETE /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 204 len: 0 microversion: 2.1 time: 0.139075 Jul 12 17:31:36.826978 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 308/644] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:31:36 2022] DELETE /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 17:31:36.836203 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-eba71c82-fe93-4f1b-bdc1-506cff8e366e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:36.836905 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-eba71c82-fe93-4f1b-bdc1-506cff8e366e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:36.842875 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eba71c82-fe93-4f1b-bdc1-506cff8e366e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:36.843320 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eba71c82-fe93-4f1b-bdc1-506cff8e366e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:36.844091 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eba71c82-fe93-4f1b-bdc1-506cff8e366e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:36.844524 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eba71c82-fe93-4f1b-bdc1-506cff8e366e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:36.932923 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0754d91e-a74d-4d83-8f1a-dca7b8b9be97 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:36.941472 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0754d91e-a74d-4d83-8f1a-dca7b8b9be97 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1724 microversion: 2.1 time: 0.214181 Jul 12 17:31:36.942151 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 337/645] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:36 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:31:36.993492 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-eba71c82-fe93-4f1b-bdc1-506cff8e366e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:37.000838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-eba71c82-fe93-4f1b-bdc1-506cff8e366e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 200 len: 1684 microversion: 2.1 time: 0.169273 Jul 12 17:31:37.001389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 309/646] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:36 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 1684 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:31:37.470401 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a48f24bc-6735-49f0-90e1-69a4053cd6d2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:37.471003 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a48f24bc-6735-49f0-90e1-69a4053cd6d2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:37.476876 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a48f24bc-6735-49f0-90e1-69a4053cd6d2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:37.477313 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a48f24bc-6735-49f0-90e1-69a4053cd6d2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:37.478124 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a48f24bc-6735-49f0-90e1-69a4053cd6d2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:37.478551 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a48f24bc-6735-49f0-90e1-69a4053cd6d2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:37.604527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a48f24bc-6735-49f0-90e1-69a4053cd6d2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:37.607957 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:37.614232 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a48f24bc-6735-49f0-90e1-69a4053cd6d2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:37.615754 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a48f24bc-6735-49f0-90e1-69a4053cd6d2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:37.616882 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a48f24bc-6735-49f0-90e1-69a4053cd6d2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.150379 Jul 12 17:31:37.617448 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 338/647] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:37 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:37.959694 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3305dfca-d708-4140-8964-30a8039d1ff8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:37.960303 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3305dfca-d708-4140-8964-30a8039d1ff8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:37.966850 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3305dfca-d708-4140-8964-30a8039d1ff8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:37.967303 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3305dfca-d708-4140-8964-30a8039d1ff8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:37.968063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3305dfca-d708-4140-8964-30a8039d1ff8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:37.968496 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3305dfca-d708-4140-8964-30a8039d1ff8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:38.020351 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6e02b37d-3556-4bc5-b021-613926ad8c48 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:38.021012 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6e02b37d-3556-4bc5-b021-613926ad8c48 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:38.028626 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e02b37d-3556-4bc5-b021-613926ad8c48 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:38.029085 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e02b37d-3556-4bc5-b021-613926ad8c48 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:38.030370 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e02b37d-3556-4bc5-b021-613926ad8c48 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:38.030370 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e02b37d-3556-4bc5-b021-613926ad8c48 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:38.138106 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3305dfca-d708-4140-8964-30a8039d1ff8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:38.146805 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3305dfca-d708-4140-8964-30a8039d1ff8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1724 microversion: 2.1 time: 0.191370 Jul 12 17:31:38.147407 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 310/648] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:37 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:38.180392 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6e02b37d-3556-4bc5-b021-613926ad8c48 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:38.187692 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6e02b37d-3556-4bc5-b021-613926ad8c48 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 200 len: 1684 microversion: 2.1 time: 0.171766 Jul 12 17:31:38.188239 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 339/649] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:38 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 1684 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:31:38.634549 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c2d5a4b6-7aeb-4634-b233-ac5a0a002f08 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:38.635192 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c2d5a4b6-7aeb-4634-b233-ac5a0a002f08 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:38.641091 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c2d5a4b6-7aeb-4634-b233-ac5a0a002f08 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:38.641541 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c2d5a4b6-7aeb-4634-b233-ac5a0a002f08 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:38.642349 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c2d5a4b6-7aeb-4634-b233-ac5a0a002f08 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:38.642787 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c2d5a4b6-7aeb-4634-b233-ac5a0a002f08 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:38.775162 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c2d5a4b6-7aeb-4634-b233-ac5a0a002f08 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:38.783464 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c2d5a4b6-7aeb-4634-b233-ac5a0a002f08 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:38.784968 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c2d5a4b6-7aeb-4634-b233-ac5a0a002f08 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:38.786144 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c2d5a4b6-7aeb-4634-b233-ac5a0a002f08 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.155512 Jul 12 17:31:38.786705 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 311/650] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:38 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:39.164457 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9d449ed5-bdbc-41ac-94aa-efe05703a10b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:39.165068 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9d449ed5-bdbc-41ac-94aa-efe05703a10b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:39.171108 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9d449ed5-bdbc-41ac-94aa-efe05703a10b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:39.171550 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9d449ed5-bdbc-41ac-94aa-efe05703a10b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:39.172300 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9d449ed5-bdbc-41ac-94aa-efe05703a10b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:39.172732 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9d449ed5-bdbc-41ac-94aa-efe05703a10b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:39.204213 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f9dca877-3d4c-4432-b942-b963600eed4b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:39.204827 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f9dca877-3d4c-4432-b942-b963600eed4b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:39.211284 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f9dca877-3d4c-4432-b942-b963600eed4b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:39.211732 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f9dca877-3d4c-4432-b942-b963600eed4b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:39.212503 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f9dca877-3d4c-4432-b942-b963600eed4b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:39.212943 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f9dca877-3d4c-4432-b942-b963600eed4b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:39.349016 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9d449ed5-bdbc-41ac-94aa-efe05703a10b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:39.356990 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9d449ed5-bdbc-41ac-94aa-efe05703a10b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1724 microversion: 2.1 time: 0.196487 Jul 12 17:31:39.357660 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 340/651] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:39 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:39.381948 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f9dca877-3d4c-4432-b942-b963600eed4b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:39.389415 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f9dca877-3d4c-4432-b942-b963600eed4b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 200 len: 1684 microversion: 2.1 time: 0.188990 Jul 12 17:31:39.390026 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 312/652] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:39 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 1684 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:31:39.804371 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-01063294-161a-4a7f-826c-3c277e540170 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:39.805010 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-01063294-161a-4a7f-826c-3c277e540170 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:39.810998 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-01063294-161a-4a7f-826c-3c277e540170 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:39.811440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-01063294-161a-4a7f-826c-3c277e540170 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:39.812188 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-01063294-161a-4a7f-826c-3c277e540170 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:39.812618 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-01063294-161a-4a7f-826c-3c277e540170 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:39.940192 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-01063294-161a-4a7f-826c-3c277e540170 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:39.949320 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-01063294-161a-4a7f-826c-3c277e540170 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:39.950863 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-01063294-161a-4a7f-826c-3c277e540170 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:39.952006 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-01063294-161a-4a7f-826c-3c277e540170 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.151539 Jul 12 17:31:39.952555 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 341/653] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:39 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:40.373858 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c39433c1-3376-4030-a104-042c701bae2a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:40.374479 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c39433c1-3376-4030-a104-042c701bae2a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:40.381471 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c39433c1-3376-4030-a104-042c701bae2a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:40.381959 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c39433c1-3376-4030-a104-042c701bae2a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:40.382729 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c39433c1-3376-4030-a104-042c701bae2a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:40.383168 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c39433c1-3376-4030-a104-042c701bae2a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:40.406437 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8ad7179b-b6fe-43c2-9940-0e9f1083b231 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:40.407049 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8ad7179b-b6fe-43c2-9940-0e9f1083b231 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:40.412870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8ad7179b-b6fe-43c2-9940-0e9f1083b231 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:40.413306 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8ad7179b-b6fe-43c2-9940-0e9f1083b231 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:40.414091 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8ad7179b-b6fe-43c2-9940-0e9f1083b231 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:40.414517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8ad7179b-b6fe-43c2-9940-0e9f1083b231 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:40.746206 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c39433c1-3376-4030-a104-042c701bae2a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:40.754916 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c39433c1-3376-4030-a104-042c701bae2a tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1724 microversion: 2.1 time: 0.384866 Jul 12 17:31:40.755488 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 313/654] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:40 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1724 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:40.785281 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8ad7179b-b6fe-43c2-9940-0e9f1083b231 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:40.792758 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8ad7179b-b6fe-43c2-9940-0e9f1083b231 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 200 len: 1684 microversion: 2.1 time: 0.390074 Jul 12 17:31:40.793267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 342/655] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:40 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 1684 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:31:40.970517 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f934bc6e-2704-475b-b8b5-77e2917c8c0a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:40.971149 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f934bc6e-2704-475b-b8b5-77e2917c8c0a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:40.977603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f934bc6e-2704-475b-b8b5-77e2917c8c0a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:40.978077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f934bc6e-2704-475b-b8b5-77e2917c8c0a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:40.978833 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f934bc6e-2704-475b-b8b5-77e2917c8c0a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:40.979258 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f934bc6e-2704-475b-b8b5-77e2917c8c0a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:41.503484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f934bc6e-2704-475b-b8b5-77e2917c8c0a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:41.512255 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f934bc6e-2704-475b-b8b5-77e2917c8c0a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:41.513957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f934bc6e-2704-475b-b8b5-77e2917c8c0a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:41.515224 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f934bc6e-2704-475b-b8b5-77e2917c8c0a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.548548 Jul 12 17:31:41.515944 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 314/656] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:40 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:41.775032 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-acef6029-378e-4aea-904c-b060a5e2ef36 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:41.776421 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-acef6029-378e-4aea-904c-b060a5e2ef36 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:41.783009 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-acef6029-378e-4aea-904c-b060a5e2ef36 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:41.783181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-acef6029-378e-4aea-904c-b060a5e2ef36 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:41.783875 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-acef6029-378e-4aea-904c-b060a5e2ef36 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:41.784309 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-acef6029-378e-4aea-904c-b060a5e2ef36 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:41.810734 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-999310d5-7beb-4e81-9af7-7fe5dafa96a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:41.811367 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-999310d5-7beb-4e81-9af7-7fe5dafa96a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:41.819078 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-999310d5-7beb-4e81-9af7-7fe5dafa96a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:41.819532 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-999310d5-7beb-4e81-9af7-7fe5dafa96a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:41.820316 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-999310d5-7beb-4e81-9af7-7fe5dafa96a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:41.820758 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-999310d5-7beb-4e81-9af7-7fe5dafa96a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:41.825826 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:41.922999 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-999310d5-7beb-4e81-9af7-7fe5dafa96a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:41.933926 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-999310d5-7beb-4e81-9af7-7fe5dafa96a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 200 len: 1616 microversion: 2.1 time: 0.127234 Jul 12 17:31:41.934507 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 315/657] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:41 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 1616 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:42.079333 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-acef6029-378e-4aea-904c-b060a5e2ef36 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:42.095524 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-acef6029-378e-4aea-904c-b060a5e2ef36 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1724 microversion: 2.1 time: 0.324343 Jul 12 17:31:42.106579 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 343/658] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:41 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1724 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:42.153514 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-d25f3e90-37c9-462c-bedb-09db3e46f506 req-91b5a771-71c4-4fa9-876d-21b1dd122021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d0b582-fd90-42a8-a0cf-9acd222b3d26", "name": "network-vif-deleted", "tag": "2a9d6ee1-0082-43be-b42c-fc278ebab767"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:42.162375 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-d25f3e90-37c9-462c-bedb-09db3e46f506 req-91b5a771-71c4-4fa9-876d-21b1dd122021 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:42.162871 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-d25f3e90-37c9-462c-bedb-09db3e46f506 req-91b5a771-71c4-4fa9-876d-21b1dd122021 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:42.173907 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-d25f3e90-37c9-462c-bedb-09db3e46f506 req-91b5a771-71c4-4fa9-876d-21b1dd122021 service nova] Creating event network-vif-deleted:2a9d6ee1-0082-43be-b42c-fc278ebab767 for instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 on hv-cinder-84932 Jul 12 17:31:42.179489 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-d25f3e90-37c9-462c-bedb-09db3e46f506 req-91b5a771-71c4-4fa9-876d-21b1dd122021 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103980 Jul 12 17:31:42.180087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 316/659] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:31:42.534064 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-86f39d9d-050c-4419-8b39-bec066fe38ad tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:42.535281 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-86f39d9d-050c-4419-8b39-bec066fe38ad tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:42.541910 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-86f39d9d-050c-4419-8b39-bec066fe38ad tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:42.542442 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-86f39d9d-050c-4419-8b39-bec066fe38ad tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:42.543303 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-86f39d9d-050c-4419-8b39-bec066fe38ad tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:42.543813 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-86f39d9d-050c-4419-8b39-bec066fe38ad tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:42.676952 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-86f39d9d-050c-4419-8b39-bec066fe38ad tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:42.685760 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-86f39d9d-050c-4419-8b39-bec066fe38ad tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:42.687391 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-86f39d9d-050c-4419-8b39-bec066fe38ad tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:42.688565 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-86f39d9d-050c-4419-8b39-bec066fe38ad tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.158581 Jul 12 17:31:42.689270 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 344/660] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:42 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:42.953338 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-91032fb1-6849-477c-9ad8-4aa623b4757d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:42.954081 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-91032fb1-6849-477c-9ad8-4aa623b4757d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:42.961303 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-91032fb1-6849-477c-9ad8-4aa623b4757d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:42.961783 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-91032fb1-6849-477c-9ad8-4aa623b4757d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:42.962584 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-91032fb1-6849-477c-9ad8-4aa623b4757d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:42.963024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-91032fb1-6849-477c-9ad8-4aa623b4757d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:43.029505 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-91032fb1-6849-477c-9ad8-4aa623b4757d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:43.037271 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-91032fb1-6849-477c-9ad8-4aa623b4757d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 200 len: 1616 microversion: 2.1 time: 0.088661 Jul 12 17:31:43.038050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 317/661] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:42 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 1616 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:43.114810 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-953eb7cd-f3fc-4b82-bebe-d56204bc2f64 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:43.115415 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-953eb7cd-f3fc-4b82-bebe-d56204bc2f64 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:43.122566 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-953eb7cd-f3fc-4b82-bebe-d56204bc2f64 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:43.123829 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-953eb7cd-f3fc-4b82-bebe-d56204bc2f64 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:43.124792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-953eb7cd-f3fc-4b82-bebe-d56204bc2f64 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:43.125490 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-953eb7cd-f3fc-4b82-bebe-d56204bc2f64 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:43.262574 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-953eb7cd-f3fc-4b82-bebe-d56204bc2f64 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:43.270581 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-953eb7cd-f3fc-4b82-bebe-d56204bc2f64 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1724 microversion: 2.1 time: 0.160047 Jul 12 17:31:43.271143 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 345/662] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:43 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:43.706652 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-89a38c65-0198-4569-b95c-8ff3b03005fc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:43.707504 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-89a38c65-0198-4569-b95c-8ff3b03005fc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:43.715035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-89a38c65-0198-4569-b95c-8ff3b03005fc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:43.715479 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-89a38c65-0198-4569-b95c-8ff3b03005fc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:43.716260 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-89a38c65-0198-4569-b95c-8ff3b03005fc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:43.716688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-89a38c65-0198-4569-b95c-8ff3b03005fc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:43.855063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-89a38c65-0198-4569-b95c-8ff3b03005fc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:43.866365 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-89a38c65-0198-4569-b95c-8ff3b03005fc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:43.867954 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-89a38c65-0198-4569-b95c-8ff3b03005fc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:43.869341 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-89a38c65-0198-4569-b95c-8ff3b03005fc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.166816 Jul 12 17:31:43.870198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 318/663] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:43 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:44.054722 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e2cc053e-2e2f-47c7-8f35-5ef38f112d32 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:44.055334 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e2cc053e-2e2f-47c7-8f35-5ef38f112d32 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:44.063006 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e2cc053e-2e2f-47c7-8f35-5ef38f112d32 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:44.063509 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e2cc053e-2e2f-47c7-8f35-5ef38f112d32 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:44.064232 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e2cc053e-2e2f-47c7-8f35-5ef38f112d32 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:44.064668 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e2cc053e-2e2f-47c7-8f35-5ef38f112d32 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:44.147713 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-f194f3e5-c32c-420b-9b0a-5b4e1b848bd3 req-b0176336-86e2-400e-ab7a-55bc8bc6b761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b5e50f-5079-438b-ac33-67623b4428f5", "name": "network-vif-plugged", "status": "completed", "tag": "e0dd8828-dbc7-4d01-9d3f-ee997fb3d5ce"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:44.155256 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e2cc053e-2e2f-47c7-8f35-5ef38f112d32 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:44.162362 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-f194f3e5-c32c-420b-9b0a-5b4e1b848bd3 req-b0176336-86e2-400e-ab7a-55bc8bc6b761 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:44.163840 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-f194f3e5-c32c-420b-9b0a-5b4e1b848bd3 req-b0176336-86e2-400e-ab7a-55bc8bc6b761 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:44.172687 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e2cc053e-2e2f-47c7-8f35-5ef38f112d32 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 200 len: 1327 microversion: 2.1 time: 0.122006 Jul 12 17:31:44.181919 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-f194f3e5-c32c-420b-9b0a-5b4e1b848bd3 req-b0176336-86e2-400e-ab7a-55bc8bc6b761 service nova] Creating event network-vif-plugged:e0dd8828-dbc7-4d01-9d3f-ee997fb3d5ce for instance 48b5e50f-5079-438b-ac33-67623b4428f5 on hv-cinder-84932 Jul 12 17:31:44.182666 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 346/664] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:44 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 1327 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:44.186700 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-f194f3e5-c32c-420b-9b0a-5b4e1b848bd3 req-b0176336-86e2-400e-ab7a-55bc8bc6b761 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124034 Jul 12 17:31:44.187284 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 319/665] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:31:44.287258 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-977aab56-277d-4de2-bb78-f0e1a8bb0df8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:44.287873 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-977aab56-277d-4de2-bb78-f0e1a8bb0df8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:44.293843 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-977aab56-277d-4de2-bb78-f0e1a8bb0df8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:44.294295 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-977aab56-277d-4de2-bb78-f0e1a8bb0df8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:44.295054 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-977aab56-277d-4de2-bb78-f0e1a8bb0df8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:44.295495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-977aab56-277d-4de2-bb78-f0e1a8bb0df8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:44.420684 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-977aab56-277d-4de2-bb78-f0e1a8bb0df8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:44.428985 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-977aab56-277d-4de2-bb78-f0e1a8bb0df8 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1724 microversion: 2.1 time: 0.146151 Jul 12 17:31:44.434593 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 347/666] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:44 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:44.888986 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-de32e7d3-af20-49fa-8170-11938be4f64f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:44.889582 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-de32e7d3-af20-49fa-8170-11938be4f64f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:44.895841 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-de32e7d3-af20-49fa-8170-11938be4f64f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:44.896290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-de32e7d3-af20-49fa-8170-11938be4f64f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:44.897051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-de32e7d3-af20-49fa-8170-11938be4f64f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:44.897482 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-de32e7d3-af20-49fa-8170-11938be4f64f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:45.028744 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-de32e7d3-af20-49fa-8170-11938be4f64f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:45.037091 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-de32e7d3-af20-49fa-8170-11938be4f64f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:45.038645 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-de32e7d3-af20-49fa-8170-11938be4f64f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:45.039783 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-de32e7d3-af20-49fa-8170-11938be4f64f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.155289 Jul 12 17:31:45.040332 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 320/667] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:44 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:45.190207 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cbb55915-5ad2-414d-ba4b-0161d3d05b97 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:45.190822 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cbb55915-5ad2-414d-ba4b-0161d3d05b97 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:45.196933 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cbb55915-5ad2-414d-ba4b-0161d3d05b97 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:45.197376 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cbb55915-5ad2-414d-ba4b-0161d3d05b97 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:45.198183 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cbb55915-5ad2-414d-ba4b-0161d3d05b97 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:45.198616 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cbb55915-5ad2-414d-ba4b-0161d3d05b97 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:45.228037 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cbb55915-5ad2-414d-ba4b-0161d3d05b97 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:45.228483 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cbb55915-5ad2-414d-ba4b-0161d3d05b97 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:45.228924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-cbb55915-5ad2-414d-ba4b-0161d3d05b97 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lazy-loading 'fault' on Instance uuid 34d0b582-fd90-42a8-a0cf-9acd222b3d26 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:31:45.271555 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cbb55915-5ad2-414d-ba4b-0161d3d05b97 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:45.278787 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cbb55915-5ad2-414d-ba4b-0161d3d05b97 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 200 len: 1332 microversion: 2.1 time: 0.092521 Jul 12 17:31:45.279351 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 348/668] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:45 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:45.446281 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-779af82e-5cb0-4ce1-ae90-d4b441a79aaf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:45.446880 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-779af82e-5cb0-4ce1-ae90-d4b441a79aaf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:45.454007 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-779af82e-5cb0-4ce1-ae90-d4b441a79aaf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:45.454462 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-779af82e-5cb0-4ce1-ae90-d4b441a79aaf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:45.455245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-779af82e-5cb0-4ce1-ae90-d4b441a79aaf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:45.455684 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-779af82e-5cb0-4ce1-ae90-d4b441a79aaf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:45.591780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-779af82e-5cb0-4ce1-ae90-d4b441a79aaf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:45.600306 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-779af82e-5cb0-4ce1-ae90-d4b441a79aaf tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1730 microversion: 2.1 time: 0.158196 Jul 12 17:31:45.605718 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 321/669] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:45 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:45.623334 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-53e855a7-33a1-46d5-b00a-ffb30bbab8b2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:45.623836 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-53e855a7-33a1-46d5-b00a-ffb30bbab8b2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:45.630021 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53e855a7-33a1-46d5-b00a-ffb30bbab8b2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:45.630475 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53e855a7-33a1-46d5-b00a-ffb30bbab8b2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:45.631241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53e855a7-33a1-46d5-b00a-ffb30bbab8b2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:45.631700 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53e855a7-33a1-46d5-b00a-ffb30bbab8b2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:45.730830 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-53e855a7-33a1-46d5-b00a-ffb30bbab8b2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111513 Jul 12 17:31:45.731485 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 349/670] 10.222.0.62 () {58 vars in 1274 bytes} [Tue Jul 12 17:31:45 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:31:46.058438 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c4b4602f-7303-4c24-91ad-ee4b87db57a3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:46.059052 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c4b4602f-7303-4c24-91ad-ee4b87db57a3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:46.065049 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c4b4602f-7303-4c24-91ad-ee4b87db57a3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:46.066037 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c4b4602f-7303-4c24-91ad-ee4b87db57a3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:46.066813 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c4b4602f-7303-4c24-91ad-ee4b87db57a3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:46.067259 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c4b4602f-7303-4c24-91ad-ee4b87db57a3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:46.196441 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c4b4602f-7303-4c24-91ad-ee4b87db57a3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:46.204889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c4b4602f-7303-4c24-91ad-ee4b87db57a3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:46.207068 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c4b4602f-7303-4c24-91ad-ee4b87db57a3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:46.208224 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c4b4602f-7303-4c24-91ad-ee4b87db57a3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.153797 Jul 12 17:31:46.208783 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 322/671] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:46 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:46.296477 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-01c99c98-7c0f-4a37-9856-bcfa226b18e6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:46.297093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-01c99c98-7c0f-4a37-9856-bcfa226b18e6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:46.303630 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-01c99c98-7c0f-4a37-9856-bcfa226b18e6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:46.304086 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-01c99c98-7c0f-4a37-9856-bcfa226b18e6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:46.304845 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-01c99c98-7c0f-4a37-9856-bcfa226b18e6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:46.305283 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-01c99c98-7c0f-4a37-9856-bcfa226b18e6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:46.319159 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-01c99c98-7c0f-4a37-9856-bcfa226b18e6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] HTTP exception thrown: Instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 could not be found. Jul 12 17:31:46.320794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-01c99c98-7c0f-4a37-9856-bcfa226b18e6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Request method failure captured: Jul 12 17:31:46.320794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 HTTP/1.1 Jul 12 17:31:46.320794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:31:46.320794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:31:46.320794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:31:46.320794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:31:46.320794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:31:46.320794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:31:46.320794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:31:46.320794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:31:46.320794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza6s95YbmpHGEF6KuEgm1a_bLJ81FwTpSTIH7MTxyWuinNdKpad_B8P_UZWneUdxW68SGH3Srj8_vZq-CuSnlwKSv16guwMSxTDbOGQyNs0XrVu8KfhrnvEOXIz2ODhAC95eTPACdOrc6qWclLz7G-TtlizrY4gQ1jWkpckM6H1sbeY Jul 12 17:31:46.320794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:31:46.320794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:31:46.320794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:31:46.320794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:31:46.320794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:31:46.320794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:31:46.320794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:31:46.320794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:31:46.320794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:31:46.320794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:31:46.322367 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4a4e837b171b4b4a9c2ad230cda53452", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:31:46.322367 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:31:46.322367 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:31:46.322367 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:31:46.322367 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:31:46.322367 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:31:46.322367 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:31:46.322367 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: 38a74ebdd59a491386aedcdbd312b363 Jul 12 17:31:46.322367 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:31:46.322367 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:31:46.322367 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 could not be found. Jul 12 17:31:46.322367 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': '34d0b582-fd90-42a8-a0cf-9acd222b3d26'} Jul 12 17:31:46.323244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:31:46.323244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:31:46.323244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:31:46.323244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:31:46.323244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:31:46.323244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:31:46.323244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:31:46.323244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:31:46.323244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:31:46.323244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:31:46.323244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 could not be found. Jul 12 17:31:46.323244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:31:46.323244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:31:46.323244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:31:46.323244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:31:46.323244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:31:46.323244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:31:46.323244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:31:46.323244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:31:46.323244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:31:46.324691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:31:46.324691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:31:46.324691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:31:46.324691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:31:46.324691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:31:46.324691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:31:46.324691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:31:46.324691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 could not be found. Jul 12 17:31:46.324691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:31:46.324691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:31:46.324691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:31:46.324691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:31:46.324691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:31:46.324691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:31:46.324691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:31:46.324691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:31:46.324691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 could not be found. Jul 12 17:31:46.324691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:31:46.325976 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-01c99c98-7c0f-4a37-9856-bcfa226b18e6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Returning 404 to user: Instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:31:46.325976 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-01c99c98-7c0f-4a37-9856-bcfa226b18e6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 404 len: 111 microversion: 2.1 time: 0.029674 Jul 12 17:31:46.325976 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 350/672] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:46 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:31:46.331225 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2f77d8a7-a37b-4c9b-9502-64e55ee28824 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '.version_select at 0x7f872988e280>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:46.352487 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2f77d8a7-a37b-4c9b-9502-64e55ee28824 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447348453" status: 202 len: 0 microversion: 2.1 time: 0.025207 Jul 12 17:31:46.353051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 323/673] 10.222.0.62 () {58 vars in 1220 bytes} [Tue Jul 12 17:31:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447348453 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:31:46.892446 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-e9609791-ba3a-45ab-9112-0665165119d6 req-0a9ceae3-db6f-4e12-83db-6697dc42f2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e5af452-8518-42e8-b587-1d1fe57554c9", "tag": "b3ccbfc5-0e69-441b-9bcc-1d315b0bf93c"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:46.900617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-e9609791-ba3a-45ab-9112-0665165119d6 req-0a9ceae3-db6f-4e12-83db-6697dc42f2a1 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:46.901098 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-e9609791-ba3a-45ab-9112-0665165119d6 req-0a9ceae3-db6f-4e12-83db-6697dc42f2a1 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:46.913171 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-e9609791-ba3a-45ab-9112-0665165119d6 req-0a9ceae3-db6f-4e12-83db-6697dc42f2a1 service nova] Creating event network-changed:b3ccbfc5-0e69-441b-9bcc-1d315b0bf93c for instance 0e5af452-8518-42e8-b587-1d1fe57554c9 on hv-cinder-84932 Jul 12 17:31:46.918148 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-e9609791-ba3a-45ab-9112-0665165119d6 req-0a9ceae3-db6f-4e12-83db-6697dc42f2a1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104411 Jul 12 17:31:46.918894 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 351/674] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:31:47.103269 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ed358942-0db3-4885-a907-f4fbee9b8ee1 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:47.103844 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ed358942-0db3-4885-a907-f4fbee9b8ee1 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:47.110139 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ed358942-0db3-4885-a907-f4fbee9b8ee1 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:47.110590 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ed358942-0db3-4885-a907-f4fbee9b8ee1 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:47.111374 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ed358942-0db3-4885-a907-f4fbee9b8ee1 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:47.111808 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ed358942-0db3-4885-a907-f4fbee9b8ee1 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:47.229183 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6868870c-ab9a-4bd4-8bb1-e10db5c4d14b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:47.230532 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6868870c-ab9a-4bd4-8bb1-e10db5c4d14b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:47.238206 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6868870c-ab9a-4bd4-8bb1-e10db5c4d14b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:47.238928 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6868870c-ab9a-4bd4-8bb1-e10db5c4d14b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:47.239916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6868870c-ab9a-4bd4-8bb1-e10db5c4d14b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:47.240346 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6868870c-ab9a-4bd4-8bb1-e10db5c4d14b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:47.242331 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-ed358942-0db3-4885-a907-f4fbee9b8ee1 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lazy-loading 'services' on Instance uuid 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:31:47.374961 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ed358942-0db3-4885-a907-f4fbee9b8ee1 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "DELETE /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2/os-volume_attachments/5d00ca24-3258-42fe-89c2-f8bca45db332" status: 202 len: 0 microversion: 2.1 time: 0.275850 Jul 12 17:31:47.376368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 324/675] 10.222.0.62 () {58 vars in 1415 bytes} [Tue Jul 12 17:31:47 2022] DELETE /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2/os-volume_attachments/5d00ca24-3258-42fe-89c2-f8bca45db332 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:31:47.386389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ff8b179e-0281-430c-9e57-0c70b53e0ae2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:47.387915 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ff8b179e-0281-430c-9e57-0c70b53e0ae2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:47.403089 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ff8b179e-0281-430c-9e57-0c70b53e0ae2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:47.404246 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ff8b179e-0281-430c-9e57-0c70b53e0ae2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:47.406941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ff8b179e-0281-430c-9e57-0c70b53e0ae2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:47.407666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ff8b179e-0281-430c-9e57-0c70b53e0ae2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:47.442582 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ff8b179e-0281-430c-9e57-0c70b53e0ae2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061298 Jul 12 17:31:47.443256 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 325/676] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:31:47 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:31:47.450036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6868870c-ab9a-4bd4-8bb1-e10db5c4d14b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:47.459146 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6868870c-ab9a-4bd4-8bb1-e10db5c4d14b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:47.460859 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6868870c-ab9a-4bd4-8bb1-e10db5c4d14b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:47.462272 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6868870c-ab9a-4bd4-8bb1-e10db5c4d14b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1810 microversion: 2.20 time: 0.238979 Jul 12 17:31:47.462746 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 352/677] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:47 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1810 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:31:48.454026 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d868e782-1dff-4006-b4c4-33fc6a3aed5e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:48.454937 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d868e782-1dff-4006-b4c4-33fc6a3aed5e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:48.461982 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d868e782-1dff-4006-b4c4-33fc6a3aed5e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:48.462437 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d868e782-1dff-4006-b4c4-33fc6a3aed5e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:48.463180 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d868e782-1dff-4006-b4c4-33fc6a3aed5e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:48.463611 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d868e782-1dff-4006-b4c4-33fc6a3aed5e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:48.480675 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-732ede78-b897-4947-9084-8389bbafe6e1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:48.482144 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-732ede78-b897-4947-9084-8389bbafe6e1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:48.494255 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d868e782-1dff-4006-b4c4-33fc6a3aed5e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044264 Jul 12 17:31:48.495066 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 326/678] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:31:48 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:31:48.497087 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-732ede78-b897-4947-9084-8389bbafe6e1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:48.497542 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-732ede78-b897-4947-9084-8389bbafe6e1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:48.498345 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-732ede78-b897-4947-9084-8389bbafe6e1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:48.498781 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-732ede78-b897-4947-9084-8389bbafe6e1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:48.626625 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-732ede78-b897-4947-9084-8389bbafe6e1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:48.635633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-732ede78-b897-4947-9084-8389bbafe6e1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:48.637162 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-732ede78-b897-4947-9084-8389bbafe6e1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:48.638344 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-732ede78-b897-4947-9084-8389bbafe6e1 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1797 microversion: 2.20 time: 0.161882 Jul 12 17:31:48.638895 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 353/679] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:31:48 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1797 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:31:48.931979 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-ea5b7757-26c0-4996-802c-64fd1d9d4e03 req-87c35a7d-89bd-4e16-bd1c-d5eb114fdcd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e5af452-8518-42e8-b587-1d1fe57554c9", "tag": "b3ccbfc5-0e69-441b-9bcc-1d315b0bf93c"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:48.940005 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-ea5b7757-26c0-4996-802c-64fd1d9d4e03 req-87c35a7d-89bd-4e16-bd1c-d5eb114fdcd0 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:48.940944 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-ea5b7757-26c0-4996-802c-64fd1d9d4e03 req-87c35a7d-89bd-4e16-bd1c-d5eb114fdcd0 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:48.952099 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-ea5b7757-26c0-4996-802c-64fd1d9d4e03 req-87c35a7d-89bd-4e16-bd1c-d5eb114fdcd0 service nova] Creating event network-changed:b3ccbfc5-0e69-441b-9bcc-1d315b0bf93c for instance 0e5af452-8518-42e8-b587-1d1fe57554c9 on hv-cinder-84932 Jul 12 17:31:48.957339 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-ea5b7757-26c0-4996-802c-64fd1d9d4e03 req-87c35a7d-89bd-4e16-bd1c-d5eb114fdcd0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029043 Jul 12 17:31:48.957969 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 327/680] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:31:49.506591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-02c08114-bd63-4563-85ed-2008f8c13a71 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:49.507504 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-02c08114-bd63-4563-85ed-2008f8c13a71 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:49.513351 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02c08114-bd63-4563-85ed-2008f8c13a71 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:49.513819 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02c08114-bd63-4563-85ed-2008f8c13a71 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:49.514570 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02c08114-bd63-4563-85ed-2008f8c13a71 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:49.514999 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-02c08114-bd63-4563-85ed-2008f8c13a71 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:49.542248 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-02c08114-bd63-4563-85ed-2008f8c13a71 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040177 Jul 12 17:31:49.542790 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 354/681] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:31:49 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 17:31:49.600695 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9b4b537e-2d83-463d-bbfb-9f9d84ce5139 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:49.601330 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9b4b537e-2d83-463d-bbfb-9f9d84ce5139 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:49.607426 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9b4b537e-2d83-463d-bbfb-9f9d84ce5139 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:49.607879 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9b4b537e-2d83-463d-bbfb-9f9d84ce5139 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:49.608721 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9b4b537e-2d83-463d-bbfb-9f9d84ce5139 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:49.609154 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9b4b537e-2d83-463d-bbfb-9f9d84ce5139 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:49.633669 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9b4b537e-2d83-463d-bbfb-9f9d84ce5139 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Going to try to terminate instance {{(pid=117939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:31:49.706809 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9b4b537e-2d83-463d-bbfb-9f9d84ce5139 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "DELETE /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 204 len: 0 microversion: 2.1 time: 0.110775 Jul 12 17:31:49.707493 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 328/682] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:31:49 2022] DELETE /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:31:49.715741 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8dcafb1e-5d32-46aa-aea5-53b442ee8972 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:49.716346 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8dcafb1e-5d32-46aa-aea5-53b442ee8972 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:49.722682 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8dcafb1e-5d32-46aa-aea5-53b442ee8972 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:49.723132 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8dcafb1e-5d32-46aa-aea5-53b442ee8972 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:49.723887 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8dcafb1e-5d32-46aa-aea5-53b442ee8972 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:49.724321 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8dcafb1e-5d32-46aa-aea5-53b442ee8972 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:49.853928 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8dcafb1e-5d32-46aa-aea5-53b442ee8972 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:49.861266 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8dcafb1e-5d32-46aa-aea5-53b442ee8972 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1683 microversion: 2.1 time: 0.149367 Jul 12 17:31:49.861874 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 355/683] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:49 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:50.879150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-fb058533-8955-4f1f-b3bc-b73d6ffd2c75 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:50.879847 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-fb058533-8955-4f1f-b3bc-b73d6ffd2c75 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:50.886467 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fb058533-8955-4f1f-b3bc-b73d6ffd2c75 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:50.886917 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fb058533-8955-4f1f-b3bc-b73d6ffd2c75 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:50.887682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fb058533-8955-4f1f-b3bc-b73d6ffd2c75 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:50.888115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fb058533-8955-4f1f-b3bc-b73d6ffd2c75 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:51.016006 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fb058533-8955-4f1f-b3bc-b73d6ffd2c75 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:51.024044 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-fb058533-8955-4f1f-b3bc-b73d6ffd2c75 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1683 microversion: 2.1 time: 0.149043 Jul 12 17:31:51.024545 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 329/684] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:50 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:52.041629 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e31f62ef-0088-474b-a8a6-c5f1ffb0096e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:52.042384 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e31f62ef-0088-474b-a8a6-c5f1ffb0096e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:52.048435 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e31f62ef-0088-474b-a8a6-c5f1ffb0096e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:52.048880 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e31f62ef-0088-474b-a8a6-c5f1ffb0096e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:52.050292 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e31f62ef-0088-474b-a8a6-c5f1ffb0096e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:52.050724 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e31f62ef-0088-474b-a8a6-c5f1ffb0096e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:52.256201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e31f62ef-0088-474b-a8a6-c5f1ffb0096e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:52.259669 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:52.264434 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e31f62ef-0088-474b-a8a6-c5f1ffb0096e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 200 len: 1683 microversion: 2.1 time: 0.226689 Jul 12 17:31:52.265004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 356/685] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:52 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 1683 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:52.565575 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-a88536c9-3025-45e1-8fd5-cffc16dc9ce4 req-cfeb29cf-3095-460e-8c24-7227e5845743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58fa8d33-4b3c-45f2-8d46-38f4f5932cf2", "name": "network-vif-deleted", "tag": "b8875684-ac70-4178-b58c-59ccedcabb36"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:52.575694 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-a88536c9-3025-45e1-8fd5-cffc16dc9ce4 req-cfeb29cf-3095-460e-8c24-7227e5845743 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:52.576474 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-a88536c9-3025-45e1-8fd5-cffc16dc9ce4 req-cfeb29cf-3095-460e-8c24-7227e5845743 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:52.589015 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-a88536c9-3025-45e1-8fd5-cffc16dc9ce4 req-cfeb29cf-3095-460e-8c24-7227e5845743 service nova] Creating event network-vif-deleted:b8875684-ac70-4178-b58c-59ccedcabb36 for instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 on hv-cinder-84932 Jul 12 17:31:52.593872 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-a88536c9-3025-45e1-8fd5-cffc16dc9ce4 req-cfeb29cf-3095-460e-8c24-7227e5845743 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032765 Jul 12 17:31:52.594762 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 330/686] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:31:53.282049 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bcfc5514-dd20-4ea1-961d-3ec21108d597 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:53.282806 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bcfc5514-dd20-4ea1-961d-3ec21108d597 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:53.289610 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bcfc5514-dd20-4ea1-961d-3ec21108d597 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:53.290095 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bcfc5514-dd20-4ea1-961d-3ec21108d597 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:53.290862 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bcfc5514-dd20-4ea1-961d-3ec21108d597 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:53.291295 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bcfc5514-dd20-4ea1-961d-3ec21108d597 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:53.305998 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-bcfc5514-dd20-4ea1-961d-3ec21108d597 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] HTTP exception thrown: Instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 could not be found. Jul 12 17:31:53.307729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bcfc5514-dd20-4ea1-961d-3ec21108d597 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Request method failure captured: Jul 12 17:31:53.307729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 HTTP/1.1 Jul 12 17:31:53.307729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:31:53.307729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:31:53.307729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:31:53.307729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:31:53.307729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:31:53.307729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:31:53.307729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:31:53.307729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:31:53.307729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza6s95YbmpHGEF6KuEgm1a_bLJ81FwTpSTIH7MTxyWuinNdKpad_B8P_UZWneUdxW68SGH3Srj8_vZq-CuSnlwKSv16guwMSxTDbOGQyNs0XrVu8KfhrnvEOXIz2ODhAC95eTPACdOrc6qWclLz7G-TtlizrY4gQ1jWkpckM6H1sbeY Jul 12 17:31:53.307729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:31:53.307729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:31:53.307729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:31:53.307729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:31:53.307729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:31:53.307729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:31:53.307729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:31:53.307729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:31:53.307729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:31:53.307729 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:31:53.309053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4a4e837b171b4b4a9c2ad230cda53452", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:31:53.309053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:31:53.309053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:31:53.309053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:31:53.309053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:31:53.309053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:31:53.309053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:31:53.309053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: 38a74ebdd59a491386aedcdbd312b363 Jul 12 17:31:53.309053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:31:53.309053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:31:53.309053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 could not be found. Jul 12 17:31:53.309053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': '58fa8d33-4b3c-45f2-8d46-38f4f5932cf2'} Jul 12 17:31:53.309796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:31:53.309796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:31:53.309796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:31:53.309796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:31:53.309796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:31:53.309796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:31:53.309796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:31:53.309796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:31:53.309796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:31:53.309796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:31:53.309796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 could not be found. Jul 12 17:31:53.309796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:31:53.309796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:31:53.309796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:31:53.309796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:31:53.309796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:31:53.309796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:31:53.309796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:31:53.309796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:31:53.309796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:31:53.310961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:31:53.310961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:31:53.310961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:31:53.310961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:31:53.310961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:31:53.310961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:31:53.310961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:31:53.310961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 could not be found. Jul 12 17:31:53.310961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:31:53.310961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:31:53.310961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:31:53.310961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:31:53.310961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:31:53.310961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:31:53.310961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:31:53.310961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:31:53.310961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 could not be found. Jul 12 17:31:53.310961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:31:53.312054 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bcfc5514-dd20-4ea1-961d-3ec21108d597 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Returning 404 to user: Instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:31:53.312054 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bcfc5514-dd20-4ea1-961d-3ec21108d597 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 404 len: 111 microversion: 2.1 time: 0.031024 Jul 12 17:31:53.312054 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 357/687] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:53 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:31:53.319805 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3c695042-f207-4db2-9473-4916e8621f2a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '.version_select at 0x7f872985de50>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:53.339046 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3c695042-f207-4db2-9473-4916e8621f2a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426069321" status: 202 len: 0 microversion: 2.1 time: 0.024400 Jul 12 17:31:53.339633 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 331/688] 10.222.0.62 () {58 vars in 1220 bytes} [Tue Jul 12 17:31:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426069321 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:31:53.990815 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0bd5f008-14c3-4a59-9957-16448a3a9325 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Action: 'create', calling method: .version_select at 0x7f872995a8b0>, body: {"keypair": {"name": "tempest-keypair-296589947", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmV/KNkt2gQXdhpv5oqpcHgxXDbd+zHoRqRZCef9xnJ31RpvyF1xzIIpBVdipjGsVwZo9M4dpV0N4Hvpuy82jjO0ll1qWu0/+4KddSSibYTSSPRrFFa0Ml9tXDNAxySpA=="}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:54.004328 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-0bd5f008-14c3-4a59-9957-16448a3a9325 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Getting quotas for project 4a4e837b171b4b4a9c2ad230cda53452. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:31:54.008345 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-0bd5f008-14c3-4a59-9957-16448a3a9325 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Getting quotas for user 38a74ebdd59a491386aedcdbd312b363 and project 4a4e837b171b4b4a9c2ad230cda53452. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:31:54.029436 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0bd5f008-14c3-4a59-9957-16448a3a9325 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.042446 Jul 12 17:31:54.030047 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 358/689] 10.222.0.62 () {60 vars in 1158 bytes} [Tue Jul 12 17:31:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:31:55.436637 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1d572b7b-e1dc-46de-8b2f-8cf31a7db0a3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-738016650", "imageRef": "b19e7830-75c9-4706-bd34-4954ba6b4cc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3be9cb9-0ea5-4d05-b64b-1defd294a562"}], "security_groups": [{"name": "tempest-securitygroup--121151188"}], "key_name": "tempest-keypair-296589947", "user_data": "}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:55.539284 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.network.neutron [None req-1d572b7b-e1dc-46de-8b2f-8cf31a7db0a3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] validate_networks() for [('e3be9cb9-0ea5-4d05-b64b-1defd294a562', None, None, None, None, None)] {{(pid=117939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:31:55.900275 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-1d572b7b-e1dc-46de-8b2f-8cf31a7db0a3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Flavor limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:31:55.900702 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-1d572b7b-e1dc-46de-8b2f-8cf31a7db0a3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Image limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:31:55.901182 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-1d572b7b-e1dc-46de-8b2f-8cf31a7db0a3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Flavor pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:31:55.901622 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-1d572b7b-e1dc-46de-8b2f-8cf31a7db0a3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Image pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:31:55.902096 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-1d572b7b-e1dc-46de-8b2f-8cf31a7db0a3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:31:55.911402 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1d572b7b-e1dc-46de-8b2f-8cf31a7db0a3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:55.911852 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1d572b7b-e1dc-46de-8b2f-8cf31a7db0a3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:55.912661 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1d572b7b-e1dc-46de-8b2f-8cf31a7db0a3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:55.913099 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1d572b7b-e1dc-46de-8b2f-8cf31a7db0a3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:55.930011 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-1d572b7b-e1dc-46de-8b2f-8cf31a7db0a3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Getting quotas for project 4a4e837b171b4b4a9c2ad230cda53452. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:31:55.933936 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-1d572b7b-e1dc-46de-8b2f-8cf31a7db0a3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Getting quotas for user 38a74ebdd59a491386aedcdbd312b363 and project 4a4e837b171b4b4a9c2ad230cda53452. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:31:55.944901 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1d572b7b-e1dc-46de-8b2f-8cf31a7db0a3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Going to run 1 instances... {{(pid=117939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:31:55.947273 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1d572b7b-e1dc-46de-8b2f-8cf31a7db0a3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19e7830-75c9-4706-bd34-4954ba6b4cc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:31:55.966912 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:55.993672 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1d572b7b-e1dc-46de-8b2f-8cf31a7db0a3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.561802 Jul 12 17:31:55.994510 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 332/690] 10.222.0.62 () {60 vars in 1146 bytes} [Tue Jul 12 17:31:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:31:56.004590 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e860960a-c630-48de-9bee-9dee0a4a5d43 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:56.005240 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e860960a-c630-48de-9bee-9dee0a4a5d43 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:56.057054 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e860960a-c630-48de-9bee-9dee0a4a5d43 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:56.063645 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e860960a-c630-48de-9bee-9dee0a4a5d43 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd" status: 200 len: 1240 microversion: 2.1 time: 0.063121 Jul 12 17:31:56.064241 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 359/691] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:55 2022] GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd => generated 1240 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:57.081915 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2b857615-47a1-4a12-afbe-823053a31b9b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:57.083171 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2b857615-47a1-4a12-afbe-823053a31b9b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:57.091106 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2b857615-47a1-4a12-afbe-823053a31b9b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:57.091851 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2b857615-47a1-4a12-afbe-823053a31b9b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:57.092952 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2b857615-47a1-4a12-afbe-823053a31b9b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:57.093539 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2b857615-47a1-4a12-afbe-823053a31b9b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:57.171143 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2b857615-47a1-4a12-afbe-823053a31b9b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:57.179113 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2b857615-47a1-4a12-afbe-823053a31b9b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd" status: 200 len: 1298 microversion: 2.1 time: 0.101720 Jul 12 17:31:57.179677 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 333/692] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:57 2022] GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:58.196748 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e73426e4-c82a-4dcc-bf88-40659d658df6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:58.197359 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e73426e4-c82a-4dcc-bf88-40659d658df6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:58.200250 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:58.205168 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e73426e4-c82a-4dcc-bf88-40659d658df6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:58.206266 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e73426e4-c82a-4dcc-bf88-40659d658df6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:58.207271 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e73426e4-c82a-4dcc-bf88-40659d658df6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:58.207713 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e73426e4-c82a-4dcc-bf88-40659d658df6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:58.527214 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e73426e4-c82a-4dcc-bf88-40659d658df6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:58.534651 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e73426e4-c82a-4dcc-bf88-40659d658df6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd" status: 200 len: 1365 microversion: 2.1 time: 0.341929 Jul 12 17:31:58.535222 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 360/693] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:58 2022] GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd => generated 1365 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:31:58.944363 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-4b8e3662-dab1-4ae1-ac13-318b42af72dc req-7c978600-e3ca-40c3-8c67-5392bf830af3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd", "tag": "0275e39e-f41d-4e49-99a5-e8873ed3df6d"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:31:58.964978 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-4b8e3662-dab1-4ae1-ac13-318b42af72dc req-7c978600-e3ca-40c3-8c67-5392bf830af3 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:58.965349 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-4b8e3662-dab1-4ae1-ac13-318b42af72dc req-7c978600-e3ca-40c3-8c67-5392bf830af3 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:58.979022 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-4b8e3662-dab1-4ae1-ac13-318b42af72dc req-7c978600-e3ca-40c3-8c67-5392bf830af3 service nova] Creating event network-changed:0275e39e-f41d-4e49-99a5-e8873ed3df6d for instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd on hv-cinder-84932 Jul 12 17:31:58.984597 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-4b8e3662-dab1-4ae1-ac13-318b42af72dc req-7c978600-e3ca-40c3-8c67-5392bf830af3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044253 Jul 12 17:31:58.985199 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 334/694] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:31:59.551233 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8965715a-7ea4-4921-8036-04472b6ea282 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:31:59.551786 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8965715a-7ea4-4921-8036-04472b6ea282 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:31:59.557781 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8965715a-7ea4-4921-8036-04472b6ea282 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:59.558231 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8965715a-7ea4-4921-8036-04472b6ea282 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:59.558989 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8965715a-7ea4-4921-8036-04472b6ea282 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:31:59.559417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8965715a-7ea4-4921-8036-04472b6ea282 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:31:59.688981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8965715a-7ea4-4921-8036-04472b6ea282 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:31:59.697004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8965715a-7ea4-4921-8036-04472b6ea282 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd" status: 200 len: 1365 microversion: 2.1 time: 0.149768 Jul 12 17:31:59.697555 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 361/695] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:31:59 2022] GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:32:00.715162 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-128269b4-14dd-4e13-8105-562b0e7fa652 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:00.715806 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-128269b4-14dd-4e13-8105-562b0e7fa652 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:00.722442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-128269b4-14dd-4e13-8105-562b0e7fa652 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:00.722886 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-128269b4-14dd-4e13-8105-562b0e7fa652 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:00.723639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-128269b4-14dd-4e13-8105-562b0e7fa652 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:00.724072 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-128269b4-14dd-4e13-8105-562b0e7fa652 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:00.741804 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:00.851365 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-128269b4-14dd-4e13-8105-562b0e7fa652 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:32:00.858624 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-128269b4-14dd-4e13-8105-562b0e7fa652 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd" status: 200 len: 1365 microversion: 2.1 time: 0.147878 Jul 12 17:32:00.859179 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 335/696] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:32:00 2022] GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:32:01.875499 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0705b2c1-d8a6-4ebc-a687-695eb0079da2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:01.876114 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0705b2c1-d8a6-4ebc-a687-695eb0079da2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:01.882860 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0705b2c1-d8a6-4ebc-a687-695eb0079da2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:01.883310 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0705b2c1-d8a6-4ebc-a687-695eb0079da2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:01.884067 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0705b2c1-d8a6-4ebc-a687-695eb0079da2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:01.884500 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0705b2c1-d8a6-4ebc-a687-695eb0079da2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:02.014627 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0705b2c1-d8a6-4ebc-a687-695eb0079da2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:32:02.022606 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0705b2c1-d8a6-4ebc-a687-695eb0079da2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd" status: 200 len: 1365 microversion: 2.1 time: 0.150990 Jul 12 17:32:02.023110 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 362/697] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:32:01 2022] GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:32:03.039800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c14ed982-786a-4185-9c04-bc1c7ec3456b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:03.040413 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c14ed982-786a-4185-9c04-bc1c7ec3456b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:03.047120 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c14ed982-786a-4185-9c04-bc1c7ec3456b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:03.047582 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c14ed982-786a-4185-9c04-bc1c7ec3456b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:03.048344 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c14ed982-786a-4185-9c04-bc1c7ec3456b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:03.048783 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c14ed982-786a-4185-9c04-bc1c7ec3456b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:03.241505 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c14ed982-786a-4185-9c04-bc1c7ec3456b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:32:03.249031 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c14ed982-786a-4185-9c04-bc1c7ec3456b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd" status: 200 len: 1365 microversion: 2.1 time: 0.213060 Jul 12 17:32:03.249726 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 336/698] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:32:03 2022] GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:32:04.141716 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-7b7b8844-de13-4e77-9fc3-2017faf6a42f req-9333c83c-f2de-40de-bb13-f8eff28aac1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd", "name": "network-vif-plugged", "status": "completed", "tag": "0275e39e-f41d-4e49-99a5-e8873ed3df6d"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:32:04.150484 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-7b7b8844-de13-4e77-9fc3-2017faf6a42f req-9333c83c-f2de-40de-bb13-f8eff28aac1d service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:04.150944 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-7b7b8844-de13-4e77-9fc3-2017faf6a42f req-9333c83c-f2de-40de-bb13-f8eff28aac1d service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:04.162898 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-7b7b8844-de13-4e77-9fc3-2017faf6a42f req-9333c83c-f2de-40de-bb13-f8eff28aac1d service nova] Creating event network-vif-plugged:0275e39e-f41d-4e49-99a5-e8873ed3df6d for instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd on hv-cinder-84932 Jul 12 17:32:04.167801 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-7b7b8844-de13-4e77-9fc3-2017faf6a42f req-9333c83c-f2de-40de-bb13-f8eff28aac1d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029809 Jul 12 17:32:04.168379 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 363/699] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:32:04.266599 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1294a5c8-8f03-4c0c-bda2-2a8e2de53312 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:04.267215 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1294a5c8-8f03-4c0c-bda2-2a8e2de53312 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:04.274333 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1294a5c8-8f03-4c0c-bda2-2a8e2de53312 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:04.274647 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1294a5c8-8f03-4c0c-bda2-2a8e2de53312 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:04.275415 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1294a5c8-8f03-4c0c-bda2-2a8e2de53312 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:04.275997 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1294a5c8-8f03-4c0c-bda2-2a8e2de53312 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:04.453938 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1294a5c8-8f03-4c0c-bda2-2a8e2de53312 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:32:04.463244 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1294a5c8-8f03-4c0c-bda2-2a8e2de53312 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd" status: 200 len: 1365 microversion: 2.1 time: 0.200465 Jul 12 17:32:04.472637 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 337/700] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:32:04 2022] GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:32:05.480478 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-75105d49-c937-4cad-8f01-ac35be1d92c1 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:05.481176 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-75105d49-c937-4cad-8f01-ac35be1d92c1 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:05.487366 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75105d49-c937-4cad-8f01-ac35be1d92c1 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:05.488458 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75105d49-c937-4cad-8f01-ac35be1d92c1 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:05.489297 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75105d49-c937-4cad-8f01-ac35be1d92c1 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:05.489603 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75105d49-c937-4cad-8f01-ac35be1d92c1 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:05.617149 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-75105d49-c937-4cad-8f01-ac35be1d92c1 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:32:05.624442 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-75105d49-c937-4cad-8f01-ac35be1d92c1 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd" status: 200 len: 1365 microversion: 2.1 time: 0.148139 Jul 12 17:32:05.625002 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 364/701] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:32:05 2022] GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:32:06.641329 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9cc24e6c-eadb-422d-b6bd-011a5dd3f81a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:06.641972 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9cc24e6c-eadb-422d-b6bd-011a5dd3f81a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:06.644496 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:06.645147 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=6 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:06.651170 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9cc24e6c-eadb-422d-b6bd-011a5dd3f81a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:06.651626 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9cc24e6c-eadb-422d-b6bd-011a5dd3f81a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:06.652395 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9cc24e6c-eadb-422d-b6bd-011a5dd3f81a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:06.652831 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9cc24e6c-eadb-422d-b6bd-011a5dd3f81a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:06.781980 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9cc24e6c-eadb-422d-b6bd-011a5dd3f81a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:32:06.789267 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9cc24e6c-eadb-422d-b6bd-011a5dd3f81a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd" status: 200 len: 1555 microversion: 2.1 time: 0.151814 Jul 12 17:32:06.789851 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 338/702] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:32:06 2022] GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:32:06.806817 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2beea93d-619b-4a70-b81a-be397d722669 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:06.807334 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2beea93d-619b-4a70-b81a-be397d722669 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:06.809287 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:06.814772 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2beea93d-619b-4a70-b81a-be397d722669 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:06.815221 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2beea93d-619b-4a70-b81a-be397d722669 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:06.816984 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2beea93d-619b-4a70-b81a-be397d722669 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:06.817433 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2beea93d-619b-4a70-b81a-be397d722669 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:06.895112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2beea93d-619b-4a70-b81a-be397d722669 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092255 Jul 12 17:32:06.895709 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 365/703] 10.222.0.62 () {58 vars in 1274 bytes} [Tue Jul 12 17:32:06 2022] GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:32:08.019798 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-8383b49d-f6c9-472e-836b-c6aaac8532f4 req-0fa701fc-a723-479a-97d7-d0296c7bf7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd", "tag": "0275e39e-f41d-4e49-99a5-e8873ed3df6d"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:32:08.028662 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-8383b49d-f6c9-472e-836b-c6aaac8532f4 req-0fa701fc-a723-479a-97d7-d0296c7bf7a8 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:08.029041 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-8383b49d-f6c9-472e-836b-c6aaac8532f4 req-0fa701fc-a723-479a-97d7-d0296c7bf7a8 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:08.043252 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-8383b49d-f6c9-472e-836b-c6aaac8532f4 req-0fa701fc-a723-479a-97d7-d0296c7bf7a8 service nova] Creating event network-changed:0275e39e-f41d-4e49-99a5-e8873ed3df6d for instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd on hv-cinder-84932 Jul 12 17:32:08.048400 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-8383b49d-f6c9-472e-836b-c6aaac8532f4 req-0fa701fc-a723-479a-97d7-d0296c7bf7a8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032250 Jul 12 17:32:08.048997 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 339/704] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:32:14.271265 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-53cfa091-8a3d-4cc1-8afe-7a7d2c5a5505 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1672962216"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:32:14.271853 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-53cfa091-8a3d-4cc1-8afe-7a7d2c5a5505 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:14.277948 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53cfa091-8a3d-4cc1-8afe-7a7d2c5a5505 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:14.278394 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53cfa091-8a3d-4cc1-8afe-7a7d2c5a5505 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:14.279150 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53cfa091-8a3d-4cc1-8afe-7a7d2c5a5505 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:14.279582 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53cfa091-8a3d-4cc1-8afe-7a7d2c5a5505 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:14.403001 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.network.security_group_api [None req-53cfa091-8a3d-4cc1-8afe-7a7d2c5a5505 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Removing security group 41bbe724-e5bc-42fc-8477-b10a0f04af5c from port e5729bfd-6f0d-43dc-88e8-b8b9b0480a96 Jul 12 17:32:14.771615 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-53cfa091-8a3d-4cc1-8afe-7a7d2c5a5505 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "POST /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f/action" status: 202 len: 0 microversion: 2.1 time: 0.504787 Jul 12 17:32:14.774135 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 366/705] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Jul 12 17:32:14 2022] POST /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:32:14.776548 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-318a9766-a22a-4176-8806-4cfbf87b894a req-20dc05e2-3e12-4118-8c0f-6cb70f6fde89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad9cb42e-ab4c-4156-8944-5c8ddd677b0f", "tag": "e5729bfd-6f0d-43dc-88e8-b8b9b0480a96"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:32:14.788034 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-318a9766-a22a-4176-8806-4cfbf87b894a req-20dc05e2-3e12-4118-8c0f-6cb70f6fde89 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:14.788400 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-318a9766-a22a-4176-8806-4cfbf87b894a req-20dc05e2-3e12-4118-8c0f-6cb70f6fde89 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:14.809010 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-318a9766-a22a-4176-8806-4cfbf87b894a req-20dc05e2-3e12-4118-8c0f-6cb70f6fde89 service nova] Creating event network-changed:e5729bfd-6f0d-43dc-88e8-b8b9b0480a96 for instance ad9cb42e-ab4c-4156-8944-5c8ddd677b0f on hv-cinder-84932 Jul 12 17:32:14.818955 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-318a9766-a22a-4176-8806-4cfbf87b894a req-20dc05e2-3e12-4118-8c0f-6cb70f6fde89 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046517 Jul 12 17:32:14.821178 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 340/706] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:32:16.350568 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1807e004-0ff9-4f05-a333-8f2497799662 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:16.351080 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1807e004-0ff9-4f05-a333-8f2497799662 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:16.357072 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1807e004-0ff9-4f05-a333-8f2497799662 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:16.357512 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1807e004-0ff9-4f05-a333-8f2497799662 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:16.358302 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1807e004-0ff9-4f05-a333-8f2497799662 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:16.358734 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1807e004-0ff9-4f05-a333-8f2497799662 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:16.436662 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-1807e004-0ff9-4f05-a333-8f2497799662 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lazy-loading 'services' on Instance uuid ad9cb42e-ab4c-4156-8944-5c8ddd677b0f {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:32:16.548290 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1807e004-0ff9-4f05-a333-8f2497799662 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f/os-volume_attachments/e92f4d5b-3822-4541-bb3f-a774ddd94ac2" status: 202 len: 0 microversion: 2.1 time: 0.202231 Jul 12 17:32:16.549359 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 367/707] 10.222.0.62 () {58 vars in 1415 bytes} [Tue Jul 12 17:32:16 2022] DELETE /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f/os-volume_attachments/e92f4d5b-3822-4541-bb3f-a774ddd94ac2 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:32:16.558750 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2a19dd53-78e0-4ba0-8c95-715ebca17aa4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:16.560453 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2a19dd53-78e0-4ba0-8c95-715ebca17aa4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:16.569633 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2a19dd53-78e0-4ba0-8c95-715ebca17aa4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:16.570201 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2a19dd53-78e0-4ba0-8c95-715ebca17aa4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:16.571219 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2a19dd53-78e0-4ba0-8c95-715ebca17aa4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:16.571718 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2a19dd53-78e0-4ba0-8c95-715ebca17aa4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:16.603348 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2a19dd53-78e0-4ba0-8c95-715ebca17aa4 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049695 Jul 12 17:32:16.604212 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 341/708] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:32:16 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:32:16.836586 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-e13bfe40-f824-4e01-95ed-39382131d8db req-f67a995f-40f5-47e4-b092-610ab62722f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad9cb42e-ab4c-4156-8944-5c8ddd677b0f", "tag": "e5729bfd-6f0d-43dc-88e8-b8b9b0480a96"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:32:16.844688 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-e13bfe40-f824-4e01-95ed-39382131d8db req-f67a995f-40f5-47e4-b092-610ab62722f6 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:16.845143 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-e13bfe40-f824-4e01-95ed-39382131d8db req-f67a995f-40f5-47e4-b092-610ab62722f6 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:16.855545 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-e13bfe40-f824-4e01-95ed-39382131d8db req-f67a995f-40f5-47e4-b092-610ab62722f6 service nova] Creating event network-changed:e5729bfd-6f0d-43dc-88e8-b8b9b0480a96 for instance ad9cb42e-ab4c-4156-8944-5c8ddd677b0f on hv-cinder-84932 Jul 12 17:32:16.860345 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-e13bfe40-f824-4e01-95ed-39382131d8db req-f67a995f-40f5-47e4-b092-610ab62722f6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028034 Jul 12 17:32:16.860923 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 368/709] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:32:17.616138 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1ce9aafa-d566-409c-9137-7c6c7a940dfa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:17.617654 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1ce9aafa-d566-409c-9137-7c6c7a940dfa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:17.624154 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1ce9aafa-d566-409c-9137-7c6c7a940dfa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:17.624607 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1ce9aafa-d566-409c-9137-7c6c7a940dfa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:17.625385 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1ce9aafa-d566-409c-9137-7c6c7a940dfa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:17.625870 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1ce9aafa-d566-409c-9137-7c6c7a940dfa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:17.656996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1ce9aafa-d566-409c-9137-7c6c7a940dfa tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045414 Jul 12 17:32:17.657572 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 342/710] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:32:17 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:32:18.669107 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a07a439b-8ef8-48e5-9512-348e26ff7057 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:18.670134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a07a439b-8ef8-48e5-9512-348e26ff7057 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:18.676366 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a07a439b-8ef8-48e5-9512-348e26ff7057 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:18.676811 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a07a439b-8ef8-48e5-9512-348e26ff7057 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:18.677563 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a07a439b-8ef8-48e5-9512-348e26ff7057 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:18.678025 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a07a439b-8ef8-48e5-9512-348e26ff7057 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:18.707077 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a07a439b-8ef8-48e5-9512-348e26ff7057 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042177 Jul 12 17:32:18.707625 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 369/711] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:32:18 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 17:32:18.717329 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e215f1ed-14f4-4c90-ac35-b43f9ffddacf tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:18.717859 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e215f1ed-14f4-4c90-ac35-b43f9ffddacf tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:18.724800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e215f1ed-14f4-4c90-ac35-b43f9ffddacf tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:18.725240 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e215f1ed-14f4-4c90-ac35-b43f9ffddacf tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:18.726018 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e215f1ed-14f4-4c90-ac35-b43f9ffddacf tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:18.726449 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e215f1ed-14f4-4c90-ac35-b43f9ffddacf tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:18.798675 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-e215f1ed-14f4-4c90-ac35-b43f9ffddacf tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] HTTP exception thrown: Instance ad9cb42e-ab4c-4156-8944-5c8ddd677b0f is not attached to volume e92f4d5b-3822-4541-bb3f-a774ddd94ac2 Jul 12 17:32:18.813996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e215f1ed-14f4-4c90-ac35-b43f9ffddacf tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Request method failure captured: Jul 12 17:32:18.813996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: DELETE /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f/os-volume_attachments/e92f4d5b-3822-4541-bb3f-a774ddd94ac2 HTTP/1.1 Jul 12 17:32:18.813996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:32:18.813996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:32:18.813996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:32:18.813996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:32:18.813996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:32:18.813996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:32:18.813996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:32:18.813996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:32:18.813996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza8ITPtBKCQG7WU0KTInBC94Db6JJqlamJEamrh2PaIXb0BD086iXrDIh03_WvKUd-z_0Ih9kFFU6JLYVmp4UfPlIbANevhWa2dx_2U2iE67dP-9fUFPkBufBzlLnfGg25JoE5g7QseqYG7yrC9QJI7ws_K2Qgv0YjApUPxXbzDuHzI Jul 12 17:32:18.813996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:32:18.813996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:32:18.813996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:32:18.813996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:32:18.813996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:32:18.813996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:32:18.813996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: 958ea0774e9d41a5a995b2693d0b0c6e Jul 12 17:32:18.813996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-TestMinimumBasicScenario-225795289 Jul 12 17:32:18.813996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:32:18.813996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:32:18.816164 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/958ea0774e9d41a5a995b2693d0b0c6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/958ea0774e9d41a5a995b2693d0b0c6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/958ea0774e9d41a5a995b2693d0b0c6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_958ea0774e9d41a5a995b2693d0b0c6e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:32:18.816164 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-TestMinimumBasicScenario-225795289 Jul 12 17:32:18.816164 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 958ea0774e9d41a5a995b2693d0b0c6e Jul 12 17:32:18.816164 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-TestMinimumBasicScenario-225795289 Jul 12 17:32:18.816164 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-TestMinimumBasicScenario-225795289-project Jul 12 17:32:18.816164 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:32:18.816164 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:32:18.816164 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: c9159fc216f14b9a9044f6ddb0d9f7b7 Jul 12 17:32:18.816164 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-TestMinimumBasicScenario-225795289-project Jul 12 17:32:18.816164 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:32:18.816164 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance ad9cb42e-ab4c-4156-8944-5c8ddd677b0f is not attached to volume e92f4d5b-3822-4541-bb3f-a774ddd94ac2 Jul 12 17:32:18.817063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'server_id': 'ad9cb42e-ab4c-4156-8944-5c8ddd677b0f', 'id': 'e92f4d5b-3822-4541-bb3f-a774ddd94ac2'} Jul 12 17:32:18.817063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:32:18.817063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:18.817063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 12 17:32:18.817063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 12 17:32:18.817063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 17:32:18.817063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 17:32:18.817063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 12 17:32:18.817063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 12 17:32:18.817063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e92f4d5b-3822-4541-bb3f-a774ddd94ac2. Jul 12 17:32:18.817063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:32:18.817063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:32:18.817063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:32:18.817063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:18.817063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:32:18.817063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:32:18.817063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:32:18.817063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:32:18.817063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:32:18.818828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:32:18.818828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 12 17:32:18.818828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 12 17:32:18.818828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad9cb42e-ab4c-4156-8944-5c8ddd677b0f is not attached to volume e92f4d5b-3822-4541-bb3f-a774ddd94ac2 Jul 12 17:32:18.818828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:32:18.818828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:32:18.818828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:32:18.818828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:18.818828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:32:18.818828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:32:18.818828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:32:18.818828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:32:18.818828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad9cb42e-ab4c-4156-8944-5c8ddd677b0f is not attached to volume e92f4d5b-3822-4541-bb3f-a774ddd94ac2 Jul 12 17:32:18.818828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:32:18.818828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e215f1ed-14f4-4c90-ac35-b43f9ffddacf tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Returning 404 to user: Instance ad9cb42e-ab4c-4156-8944-5c8ddd677b0f is not attached to volume e92f4d5b-3822-4541-bb3f-a774ddd94ac2 {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:32:18.820224 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e215f1ed-14f4-4c90-ac35-b43f9ffddacf tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f/os-volume_attachments/e92f4d5b-3822-4541-bb3f-a774ddd94ac2" status: 404 len: 154 microversion: 2.1 time: 0.102141 Jul 12 17:32:18.820224 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 343/712] 10.222.0.62 () {58 vars in 1415 bytes} [Tue Jul 12 17:32:18 2022] DELETE /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f/os-volume_attachments/e92f4d5b-3822-4541-bb3f-a774ddd94ac2 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:32:19.948005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-dc672589-b5e6-4007-9340-179d6b5afe54 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:19.948520 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-dc672589-b5e6-4007-9340-179d6b5afe54 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:19.954405 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dc672589-b5e6-4007-9340-179d6b5afe54 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:19.954843 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dc672589-b5e6-4007-9340-179d6b5afe54 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:19.955604 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dc672589-b5e6-4007-9340-179d6b5afe54 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:19.956509 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dc672589-b5e6-4007-9340-179d6b5afe54 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:19.980183 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-dc672589-b5e6-4007-9340-179d6b5afe54 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:32:20.051118 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-dc672589-b5e6-4007-9340-179d6b5afe54 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 204 len: 0 microversion: 2.1 time: 0.106319 Jul 12 17:32:20.051773 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 370/713] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:32:19 2022] DELETE /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:32:20.060138 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4eca2cfd-d376-4c13-bc89-0c761a64c891 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:20.060757 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4eca2cfd-d376-4c13-bc89-0c761a64c891 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:20.067356 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4eca2cfd-d376-4c13-bc89-0c761a64c891 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:20.067813 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4eca2cfd-d376-4c13-bc89-0c761a64c891 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:20.068831 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4eca2cfd-d376-4c13-bc89-0c761a64c891 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:20.069267 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4eca2cfd-d376-4c13-bc89-0c761a64c891 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:20.198136 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4eca2cfd-d376-4c13-bc89-0c761a64c891 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:32:20.205493 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4eca2cfd-d376-4c13-bc89-0c761a64c891 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1553 microversion: 2.1 time: 0.149208 Jul 12 17:32:20.206673 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 344/714] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:32:20 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:32:21.224091 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-42591651-2555-4baa-9b43-cf74d5dd4472 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:21.224779 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-42591651-2555-4baa-9b43-cf74d5dd4472 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:21.232977 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-42591651-2555-4baa-9b43-cf74d5dd4472 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:21.233835 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-42591651-2555-4baa-9b43-cf74d5dd4472 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:21.235183 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-42591651-2555-4baa-9b43-cf74d5dd4472 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:21.235987 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-42591651-2555-4baa-9b43-cf74d5dd4472 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:21.368318 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-42591651-2555-4baa-9b43-cf74d5dd4472 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:32:21.375530 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-42591651-2555-4baa-9b43-cf74d5dd4472 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1553 microversion: 2.1 time: 0.156244 Jul 12 17:32:21.376084 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 371/715] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:32:21 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:32:22.391897 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2ddc8207-b892-4429-8a86-93fd8e378f1b tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:22.392512 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2ddc8207-b892-4429-8a86-93fd8e378f1b tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:22.398986 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2ddc8207-b892-4429-8a86-93fd8e378f1b tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:22.399438 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2ddc8207-b892-4429-8a86-93fd8e378f1b tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:22.400215 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2ddc8207-b892-4429-8a86-93fd8e378f1b tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:22.400650 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2ddc8207-b892-4429-8a86-93fd8e378f1b tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:22.621616 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2ddc8207-b892-4429-8a86-93fd8e378f1b tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9159fc216f14b9a9044f6ddb0d9f7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958ea0774e9d41a5a995b2693d0b0c6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:32:22.629517 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2ddc8207-b892-4429-8a86-93fd8e378f1b tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 200 len: 1553 microversion: 2.1 time: 0.241481 Jul 12 17:32:22.630071 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 345/716] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:32:22 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 1553 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:32:22.860665 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-42bd3423-182d-4b62-b868-a237236a11f6 req-9d30efa2-7082-4de7-8041-c11f4fdadb46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad9cb42e-ab4c-4156-8944-5c8ddd677b0f", "name": "network-vif-deleted", "tag": "e5729bfd-6f0d-43dc-88e8-b8b9b0480a96"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:32:22.870284 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-42bd3423-182d-4b62-b868-a237236a11f6 req-9d30efa2-7082-4de7-8041-c11f4fdadb46 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:22.871036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-42bd3423-182d-4b62-b868-a237236a11f6 req-9d30efa2-7082-4de7-8041-c11f4fdadb46 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:22.882395 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-42bd3423-182d-4b62-b868-a237236a11f6 req-9d30efa2-7082-4de7-8041-c11f4fdadb46 service nova] Creating event network-vif-deleted:e5729bfd-6f0d-43dc-88e8-b8b9b0480a96 for instance ad9cb42e-ab4c-4156-8944-5c8ddd677b0f on hv-cinder-84932 Jul 12 17:32:22.888549 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-42bd3423-182d-4b62-b868-a237236a11f6 req-9d30efa2-7082-4de7-8041-c11f4fdadb46 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030796 Jul 12 17:32:22.889534 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 372/717] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:32:23.646481 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0adb0db4-a0c2-43f3-96a4-a7748e946d83 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:23.647097 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0adb0db4-a0c2-43f3-96a4-a7748e946d83 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] [instance: ad9cb42e-ab4c-4156-8944-5c8ddd677b0f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:23.653556 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0adb0db4-a0c2-43f3-96a4-a7748e946d83 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:23.654033 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0adb0db4-a0c2-43f3-96a4-a7748e946d83 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:23.654797 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0adb0db4-a0c2-43f3-96a4-a7748e946d83 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:23.655233 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0adb0db4-a0c2-43f3-96a4-a7748e946d83 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:23.668702 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-0adb0db4-a0c2-43f3-96a4-a7748e946d83 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] HTTP exception thrown: Instance ad9cb42e-ab4c-4156-8944-5c8ddd677b0f could not be found. Jul 12 17:32:23.670221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0adb0db4-a0c2-43f3-96a4-a7748e946d83 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Request method failure captured: Jul 12 17:32:23.670221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f HTTP/1.1 Jul 12 17:32:23.670221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:32:23.670221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:32:23.670221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:32:23.670221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:32:23.670221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:32:23.670221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:32:23.670221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:32:23.670221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:32:23.670221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza8ITPtBKCQG7WU0KTInBC94Db6JJqlamJEamrh2PaIXb0BD086iXrDIh03_WvKUd-z_0Ih9kFFU6JLYVmp4UfPlIbANevhWa2dx_2U2iE67dP-9fUFPkBufBzlLnfGg25JoE5g7QseqYG7yrC9QJI7ws_K2Qgv0YjApUPxXbzDuHzI Jul 12 17:32:23.670221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:32:23.670221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:32:23.670221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:32:23.670221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:32:23.670221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:32:23.670221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:32:23.670221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: 958ea0774e9d41a5a995b2693d0b0c6e Jul 12 17:32:23.670221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-TestMinimumBasicScenario-225795289 Jul 12 17:32:23.670221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:32:23.670221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:32:23.671800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/958ea0774e9d41a5a995b2693d0b0c6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/958ea0774e9d41a5a995b2693d0b0c6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/958ea0774e9d41a5a995b2693d0b0c6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_958ea0774e9d41a5a995b2693d0b0c6e", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:32:23.671800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-TestMinimumBasicScenario-225795289 Jul 12 17:32:23.671800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 958ea0774e9d41a5a995b2693d0b0c6e Jul 12 17:32:23.671800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-TestMinimumBasicScenario-225795289 Jul 12 17:32:23.671800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-TestMinimumBasicScenario-225795289-project Jul 12 17:32:23.671800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:32:23.671800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:32:23.671800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: c9159fc216f14b9a9044f6ddb0d9f7b7 Jul 12 17:32:23.671800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-TestMinimumBasicScenario-225795289-project Jul 12 17:32:23.671800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:32:23.671800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance ad9cb42e-ab4c-4156-8944-5c8ddd677b0f could not be found. Jul 12 17:32:23.671800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': 'ad9cb42e-ab4c-4156-8944-5c8ddd677b0f'} Jul 12 17:32:23.672639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:32:23.672639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:23.672639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:32:23.672639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:32:23.672639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:32:23.672639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:32:23.672639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:32:23.672639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:32:23.672639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:32:23.672639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:32:23.672639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad9cb42e-ab4c-4156-8944-5c8ddd677b0f could not be found. Jul 12 17:32:23.672639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:32:23.672639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:32:23.672639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:32:23.672639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:23.672639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:32:23.672639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:32:23.672639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:32:23.672639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:32:23.672639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:32:23.673868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:32:23.673868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:32:23.673868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:32:23.673868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:32:23.673868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:32:23.673868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:32:23.673868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:32:23.673868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad9cb42e-ab4c-4156-8944-5c8ddd677b0f could not be found. Jul 12 17:32:23.673868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:32:23.673868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:32:23.673868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:32:23.673868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:32:23.673868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:32:23.673868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:32:23.673868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:32:23.673868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:32:23.673868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad9cb42e-ab4c-4156-8944-5c8ddd677b0f could not be found. Jul 12 17:32:23.673868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:32:23.675577 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0adb0db4-a0c2-43f3-96a4-a7748e946d83 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Returning 404 to user: Instance ad9cb42e-ab4c-4156-8944-5c8ddd677b0f could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:32:23.675577 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0adb0db4-a0c2-43f3-96a4-a7748e946d83 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f" status: 404 len: 111 microversion: 2.1 time: 0.029131 Jul 12 17:32:23.675577 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 346/718] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:32:23 2022] GET /compute/v2.1/servers/ad9cb42e-ab4c-4156-8944-5c8ddd677b0f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:32:23.681380 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6a49afe6-143c-43d3-82da-b04626d7f3a2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] Calling method '.version_select at 0x7f87299e1dc0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:23.699069 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6a49afe6-143c-43d3-82da-b04626d7f3a2 tempest-TestMinimumBasicScenario-225795289 tempest-TestMinimumBasicScenario-225795289-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1932402175" status: 202 len: 0 microversion: 2.1 time: 0.021870 Jul 12 17:32:23.699609 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 373/719] 10.222.0.62 () {58 vars in 1271 bytes} [Tue Jul 12 17:32:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1932402175 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:32:41.089937 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=28 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:41.090727 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=56 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:41.260709 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a8478683-0536-41a5-aaf5-a6ede324d002 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Action: 'create', calling method: .version_select at 0x7f87298a4670>, body: {"keypair": {"name": "tempest-TestShelveInstance-230823032", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3Dfs1mlKOYuxoNRI+B94MWv0Thac01mPdBdQsDCZv6JF+WmmP12gm+dhuVqUiLEtpE2Q0JdO7yMEZJ9o7gYoIB7sCw7x6WnKPwI5bTM2s/ZVaPAZ5kBytDm6zOKYPAsQ=="}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:32:41.275337 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-a8478683-0536-41a5-aaf5-a6ede324d002 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Getting quotas for project 6a054b68c85844739e5df76de96a12e7. Resources: {'key_pairs'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:32:41.279155 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-a8478683-0536-41a5-aaf5-a6ede324d002 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Getting quotas for user 5bd18bd359544360af0956a4567cf09d and project 6a054b68c85844739e5df76de96a12e7. Resources: {'key_pairs'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:32:41.305300 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a8478683-0536-41a5-aaf5-a6ede324d002 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.220222 Jul 12 17:32:41.305966 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 347/720] 10.222.0.62 () {60 vars in 1158 bytes} [Tue Jul 12 17:32:41 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:32:53.283271 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:53.284046 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:53.288574 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fb7c055b-200d-4118-b56e-f1fec8b7402d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:53.289342 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fb7c055b-200d-4118-b56e-f1fec8b7402d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:53.297357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fb7c055b-200d-4118-b56e-f1fec8b7402d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:53.297765 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fb7c055b-200d-4118-b56e-f1fec8b7402d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:53.298523 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fb7c055b-200d-4118-b56e-f1fec8b7402d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:53.299445 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fb7c055b-200d-4118-b56e-f1fec8b7402d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:53.381165 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-fb7c055b-200d-4118-b56e-f1fec8b7402d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lazy-loading 'services' on Instance uuid 0e5af452-8518-42e8-b587-1d1fe57554c9 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:32:53.451764 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fb7c055b-200d-4118-b56e-f1fec8b7402d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9/os-volume_attachments/c5e21b48-a191-47c9-8d07-b5e0dddde571" status: 202 len: 0 microversion: 2.1 time: 0.168598 Jul 12 17:32:53.452342 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 374/721] 10.222.0.62 () {58 vars in 1415 bytes} [Tue Jul 12 17:32:53 2022] DELETE /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9/os-volume_attachments/c5e21b48-a191-47c9-8d07-b5e0dddde571 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:32:53.458384 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=4 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:53.459130 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:53.463649 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8c7ff2db-9887-4a81-9592-01cbcfea08a7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:53.464646 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8c7ff2db-9887-4a81-9592-01cbcfea08a7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:53.474901 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8c7ff2db-9887-4a81-9592-01cbcfea08a7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:53.475357 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8c7ff2db-9887-4a81-9592-01cbcfea08a7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:53.476142 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8c7ff2db-9887-4a81-9592-01cbcfea08a7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:53.476583 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8c7ff2db-9887-4a81-9592-01cbcfea08a7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:53.506789 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8c7ff2db-9887-4a81-9592-01cbcfea08a7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049641 Jul 12 17:32:53.507548 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 348/722] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:32:53 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:32:54.518819 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3deee26c-290c-4eaf-8223-2fbb0aa07bc7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:54.519679 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3deee26c-290c-4eaf-8223-2fbb0aa07bc7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:54.525668 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3deee26c-290c-4eaf-8223-2fbb0aa07bc7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:54.526144 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3deee26c-290c-4eaf-8223-2fbb0aa07bc7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:54.526897 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3deee26c-290c-4eaf-8223-2fbb0aa07bc7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:54.527322 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3deee26c-290c-4eaf-8223-2fbb0aa07bc7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:54.558329 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3deee26c-290c-4eaf-8223-2fbb0aa07bc7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044432 Jul 12 17:32:54.558969 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 375/723] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:32:54 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:32:55.570756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a22d1b31-d64f-43aa-aa3a-e226b4e0cdec tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:55.571668 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a22d1b31-d64f-43aa-aa3a-e226b4e0cdec tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:55.578268 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a22d1b31-d64f-43aa-aa3a-e226b4e0cdec tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:55.578720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a22d1b31-d64f-43aa-aa3a-e226b4e0cdec tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:55.579505 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a22d1b31-d64f-43aa-aa3a-e226b4e0cdec tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:55.580551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a22d1b31-d64f-43aa-aa3a-e226b4e0cdec tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:55.610528 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a22d1b31-d64f-43aa-aa3a-e226b4e0cdec tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043946 Jul 12 17:32:55.611088 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 349/724] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:32:55 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 17:32:55.687058 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-55baaef6-f04c-4d3d-aac5-187ceb9a8a43 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:55.687599 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-55baaef6-f04c-4d3d-aac5-187ceb9a8a43 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:55.694359 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-55baaef6-f04c-4d3d-aac5-187ceb9a8a43 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:55.694799 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-55baaef6-f04c-4d3d-aac5-187ceb9a8a43 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:55.695547 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-55baaef6-f04c-4d3d-aac5-187ceb9a8a43 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:55.695980 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-55baaef6-f04c-4d3d-aac5-187ceb9a8a43 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:55.720746 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-55baaef6-f04c-4d3d-aac5-187ceb9a8a43 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:32:55.798777 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-55baaef6-f04c-4d3d-aac5-187ceb9a8a43 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 204 len: 0 microversion: 2.1 time: 0.114714 Jul 12 17:32:55.799598 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 376/725] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:32:55 2022] DELETE /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:32:55.808286 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-694b2c68-8020-4264-83cf-ab9be5024bd7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:55.808983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-694b2c68-8020-4264-83cf-ab9be5024bd7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:55.815731 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-694b2c68-8020-4264-83cf-ab9be5024bd7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:55.816175 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-694b2c68-8020-4264-83cf-ab9be5024bd7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:55.816922 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-694b2c68-8020-4264-83cf-ab9be5024bd7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:55.817346 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-694b2c68-8020-4264-83cf-ab9be5024bd7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:55.833468 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-054505e0-d319-47d9-9dca-63be83014627 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:55.833993 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-054505e0-d319-47d9-9dca-63be83014627 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:55.839844 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-054505e0-d319-47d9-9dca-63be83014627 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:55.840294 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-054505e0-d319-47d9-9dca-63be83014627 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:55.841068 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-054505e0-d319-47d9-9dca-63be83014627 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:55.841505 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-054505e0-d319-47d9-9dca-63be83014627 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:55.870130 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-054505e0-d319-47d9-9dca-63be83014627 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/os-volume_attachments/7d5130ef-e7a4-4d52-9737-ed6938a6d3f2" status: 200 len: 194 microversion: 2.20 time: 0.154268 Jul 12 17:32:55.870693 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 350/726] 10.222.0.62 () {60 vars in 1453 bytes} [Tue Jul 12 17:32:55 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/os-volume_attachments/7d5130ef-e7a4-4d52-9737-ed6938a6d3f2 => generated 194 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 17:32:55.934701 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4ced5813-75b2-4d0f-a49c-56eade5f2060 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:55.935197 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4ced5813-75b2-4d0f-a49c-56eade5f2060 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:55.941720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4ced5813-75b2-4d0f-a49c-56eade5f2060 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:55.942230 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4ced5813-75b2-4d0f-a49c-56eade5f2060 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:55.943264 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4ced5813-75b2-4d0f-a49c-56eade5f2060 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:55.943697 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4ced5813-75b2-4d0f-a49c-56eade5f2060 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:55.948956 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-694b2c68-8020-4264-83cf-ab9be5024bd7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:32:55.956826 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-694b2c68-8020-4264-83cf-ab9be5024bd7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1690 microversion: 2.1 time: 0.152768 Jul 12 17:32:55.957396 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 377/727] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:32:55 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:32:56.020767 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-4ced5813-75b2-4d0f-a49c-56eade5f2060 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lazy-loading 'services' on Instance uuid 48b5e50f-5079-438b-ac33-67623b4428f5 {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:32:56.092136 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4ced5813-75b2-4d0f-a49c-56eade5f2060 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "DELETE /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/os-volume_attachments/7d5130ef-e7a4-4d52-9737-ed6938a6d3f2" status: 202 len: 0 microversion: 2.20 time: 0.161235 Jul 12 17:32:56.092747 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 351/728] 10.222.0.62 () {60 vars in 1456 bytes} [Tue Jul 12 17:32:55 2022] DELETE /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/os-volume_attachments/7d5130ef-e7a4-4d52-9737-ed6938a6d3f2 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 12 17:32:56.101066 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9567b91f-860e-4773-9eb3-b0fc18b751bc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:56.102018 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9567b91f-860e-4773-9eb3-b0fc18b751bc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:56.107989 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9567b91f-860e-4773-9eb3-b0fc18b751bc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:56.108437 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9567b91f-860e-4773-9eb3-b0fc18b751bc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:56.109199 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9567b91f-860e-4773-9eb3-b0fc18b751bc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:56.109637 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9567b91f-860e-4773-9eb3-b0fc18b751bc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:56.138364 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9567b91f-860e-4773-9eb3-b0fc18b751bc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041232 Jul 12 17:32:56.138906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 378/729] 10.222.0.62 () {60 vars in 1342 bytes} [Tue Jul 12 17:32:56 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:32:56.974999 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d091e83c-f2be-478b-b8bf-ec891bbdb2af tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:56.975728 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d091e83c-f2be-478b-b8bf-ec891bbdb2af tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:56.982058 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d091e83c-f2be-478b-b8bf-ec891bbdb2af tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:56.982443 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d091e83c-f2be-478b-b8bf-ec891bbdb2af tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:56.983214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d091e83c-f2be-478b-b8bf-ec891bbdb2af tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:56.983655 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d091e83c-f2be-478b-b8bf-ec891bbdb2af tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:57.112244 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d091e83c-f2be-478b-b8bf-ec891bbdb2af tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:32:57.119655 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d091e83c-f2be-478b-b8bf-ec891bbdb2af tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1690 microversion: 2.1 time: 0.150114 Jul 12 17:32:57.120220 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 352/730] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:32:56 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:32:57.149820 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-302bf698-f1e0-4bb4-9ee0-6c35820b83e9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:57.150771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-302bf698-f1e0-4bb4-9ee0-6c35820b83e9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:57.156667 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-302bf698-f1e0-4bb4-9ee0-6c35820b83e9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:57.157127 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-302bf698-f1e0-4bb4-9ee0-6c35820b83e9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:57.158280 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-302bf698-f1e0-4bb4-9ee0-6c35820b83e9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:57.158720 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-302bf698-f1e0-4bb4-9ee0-6c35820b83e9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:57.186548 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-302bf698-f1e0-4bb4-9ee0-6c35820b83e9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040717 Jul 12 17:32:57.187091 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 379/731] 10.222.0.62 () {60 vars in 1342 bytes} [Tue Jul 12 17:32:57 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:32:58.136877 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-79334a46-cdab-45ac-9737-39518aaa292e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:58.137479 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-79334a46-cdab-45ac-9737-39518aaa292e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:58.143775 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-79334a46-cdab-45ac-9737-39518aaa292e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:58.144220 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-79334a46-cdab-45ac-9737-39518aaa292e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:58.144976 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-79334a46-cdab-45ac-9737-39518aaa292e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:58.145409 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-79334a46-cdab-45ac-9737-39518aaa292e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:58.198390 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c58af09d-1fe6-46c0-82b6-202030fd53ac tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:58.199540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c58af09d-1fe6-46c0-82b6-202030fd53ac tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:58.206178 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c58af09d-1fe6-46c0-82b6-202030fd53ac tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:58.206713 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c58af09d-1fe6-46c0-82b6-202030fd53ac tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:58.207536 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c58af09d-1fe6-46c0-82b6-202030fd53ac tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:58.208036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c58af09d-1fe6-46c0-82b6-202030fd53ac tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:58.239000 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c58af09d-1fe6-46c0-82b6-202030fd53ac tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044563 Jul 12 17:32:58.239771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 380/732] 10.222.0.62 () {60 vars in 1342 bytes} [Tue Jul 12 17:32:58 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 17:32:58.273183 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-79334a46-cdab-45ac-9737-39518aaa292e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:32:58.280546 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-79334a46-cdab-45ac-9737-39518aaa292e tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1690 microversion: 2.1 time: 0.147568 Jul 12 17:32:58.281107 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 353/733] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:32:58 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1690 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:32:59.250707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cf2dd6f7-9677-4932-9593-ac29d709183a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:59.251608 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cf2dd6f7-9677-4932-9593-ac29d709183a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:59.257662 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf2dd6f7-9677-4932-9593-ac29d709183a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:59.258133 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf2dd6f7-9677-4932-9593-ac29d709183a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:59.258877 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf2dd6f7-9677-4932-9593-ac29d709183a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:59.259303 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf2dd6f7-9677-4932-9593-ac29d709183a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:59.287739 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cf2dd6f7-9677-4932-9593-ac29d709183a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041015 Jul 12 17:32:59.288272 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 381/734] 10.222.0.62 () {60 vars in 1342 bytes} [Tue Jul 12 17:32:59 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:32:59.297765 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4a9c408e-e825-4d4d-9e81-18a2c549f8ce tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:32:59.298376 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4a9c408e-e825-4d4d-9e81-18a2c549f8ce tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:32:59.304643 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4a9c408e-e825-4d4d-9e81-18a2c549f8ce tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:59.305086 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4a9c408e-e825-4d4d-9e81-18a2c549f8ce tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:59.305874 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4a9c408e-e825-4d4d-9e81-18a2c549f8ce tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:32:59.306307 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4a9c408e-e825-4d4d-9e81-18a2c549f8ce tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:32:59.435573 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4a9c408e-e825-4d4d-9e81-18a2c549f8ce tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:32:59.443701 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4a9c408e-e825-4d4d-9e81-18a2c549f8ce tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1690 microversion: 2.1 time: 0.149711 Jul 12 17:32:59.444265 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 354/735] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:32:59 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:00.301495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7eb2ee16-8c81-4755-b689-8aada8b946d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:00.302565 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7eb2ee16-8c81-4755-b689-8aada8b946d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:00.308613 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7eb2ee16-8c81-4755-b689-8aada8b946d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:00.309352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7eb2ee16-8c81-4755-b689-8aada8b946d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:00.310192 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7eb2ee16-8c81-4755-b689-8aada8b946d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:00.310678 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7eb2ee16-8c81-4755-b689-8aada8b946d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:00.341003 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7eb2ee16-8c81-4755-b689-8aada8b946d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045512 Jul 12 17:33:00.341583 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 382/736] 10.222.0.62 () {60 vars in 1342 bytes} [Tue Jul 12 17:33:00 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:33:00.460894 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9ea46bbb-b964-4075-8941-305ad67df9a1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:00.461526 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9ea46bbb-b964-4075-8941-305ad67df9a1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:00.469966 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9ea46bbb-b964-4075-8941-305ad67df9a1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:00.470414 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9ea46bbb-b964-4075-8941-305ad67df9a1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:00.471186 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9ea46bbb-b964-4075-8941-305ad67df9a1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:00.472254 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9ea46bbb-b964-4075-8941-305ad67df9a1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:00.834440 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9ea46bbb-b964-4075-8941-305ad67df9a1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:00.841804 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9ea46bbb-b964-4075-8941-305ad67df9a1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1690 microversion: 2.1 time: 0.384737 Jul 12 17:33:00.842649 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 355/737] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:00 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1690 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:01.354007 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7d54a842-6e30-43d1-bc13-e0e095639b22 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:01.354807 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7d54a842-6e30-43d1-bc13-e0e095639b22 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:01.364703 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-554f9fe7-4fac-4a31-bc1b-610b47ed082e req-2898d6e4-0f6a-4bcd-b022-7dec8ee2989e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5af452-8518-42e8-b587-1d1fe57554c9", "name": "network-vif-deleted", "tag": "b3ccbfc5-0e69-441b-9bcc-1d315b0bf93c"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:33:01.371609 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7d54a842-6e30-43d1-bc13-e0e095639b22 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:01.372331 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7d54a842-6e30-43d1-bc13-e0e095639b22 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:01.373371 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7d54a842-6e30-43d1-bc13-e0e095639b22 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:01.374063 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7d54a842-6e30-43d1-bc13-e0e095639b22 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:01.374572 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-554f9fe7-4fac-4a31-bc1b-610b47ed082e req-2898d6e4-0f6a-4bcd-b022-7dec8ee2989e service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:01.375012 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-554f9fe7-4fac-4a31-bc1b-610b47ed082e req-2898d6e4-0f6a-4bcd-b022-7dec8ee2989e service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:01.398676 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-554f9fe7-4fac-4a31-bc1b-610b47ed082e req-2898d6e4-0f6a-4bcd-b022-7dec8ee2989e service nova] Creating event network-vif-deleted:b3ccbfc5-0e69-441b-9bcc-1d315b0bf93c for instance 0e5af452-8518-42e8-b587-1d1fe57554c9 on hv-cinder-84932 Jul 12 17:33:01.403888 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-554f9fe7-4fac-4a31-bc1b-610b47ed082e req-2898d6e4-0f6a-4bcd-b022-7dec8ee2989e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043187 Jul 12 17:33:01.404842 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 356/738] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:33:01.409884 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7d54a842-6e30-43d1-bc13-e0e095639b22 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059482 Jul 12 17:33:01.410556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 383/739] 10.222.0.62 () {60 vars in 1342 bytes} [Tue Jul 12 17:33:01 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:01.476350 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3250261b-ebb0-4fcb-aded-aa74ecd5344e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:01.477639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3250261b-ebb0-4fcb-aded-aa74ecd5344e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:01.484306 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3250261b-ebb0-4fcb-aded-aa74ecd5344e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:01.484757 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3250261b-ebb0-4fcb-aded-aa74ecd5344e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:01.485565 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3250261b-ebb0-4fcb-aded-aa74ecd5344e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:01.486203 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3250261b-ebb0-4fcb-aded-aa74ecd5344e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:01.513296 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3250261b-ebb0-4fcb-aded-aa74ecd5344e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Going to try to terminate instance {{(pid=117939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:33:01.605962 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3250261b-ebb0-4fcb-aded-aa74ecd5344e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "DELETE /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 204 len: 0 microversion: 2.20 time: 0.134603 Jul 12 17:33:01.606990 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 357/740] 10.222.0.62 () {60 vars in 1279 bytes} [Tue Jul 12 17:33:01 2022] DELETE /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 17:33:01.622937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b7555e37-b715-415a-a6a6-057d9e0bcf0a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:01.623467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b7555e37-b715-415a-a6a6-057d9e0bcf0a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:01.631607 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7555e37-b715-415a-a6a6-057d9e0bcf0a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:01.632392 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7555e37-b715-415a-a6a6-057d9e0bcf0a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:01.633249 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7555e37-b715-415a-a6a6-057d9e0bcf0a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:01.633706 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7555e37-b715-415a-a6a6-057d9e0bcf0a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:01.764347 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b7555e37-b715-415a-a6a6-057d9e0bcf0a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:01.772980 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b7555e37-b715-415a-a6a6-057d9e0bcf0a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:01.774523 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b7555e37-b715-415a-a6a6-057d9e0bcf0a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:01.775692 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b7555e37-b715-415a-a6a6-057d9e0bcf0a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1725 microversion: 2.20 time: 0.156733 Jul 12 17:33:01.776250 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 384/741] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:33:01 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:33:01.859283 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e54aaa4d-ad74-4037-a62a-8ae766ee14c1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:01.860025 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e54aaa4d-ad74-4037-a62a-8ae766ee14c1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:01.867076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e54aaa4d-ad74-4037-a62a-8ae766ee14c1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:01.867533 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e54aaa4d-ad74-4037-a62a-8ae766ee14c1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:01.868312 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e54aaa4d-ad74-4037-a62a-8ae766ee14c1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:01.868755 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e54aaa4d-ad74-4037-a62a-8ae766ee14c1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:01.899865 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e54aaa4d-ad74-4037-a62a-8ae766ee14c1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:01.900321 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e54aaa4d-ad74-4037-a62a-8ae766ee14c1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:01.900771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-e54aaa4d-ad74-4037-a62a-8ae766ee14c1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lazy-loading 'fault' on Instance uuid 0e5af452-8518-42e8-b587-1d1fe57554c9 {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:33:01.947500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e54aaa4d-ad74-4037-a62a-8ae766ee14c1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:01.955265 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e54aaa4d-ad74-4037-a62a-8ae766ee14c1 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1336 microversion: 2.1 time: 0.100219 Jul 12 17:33:01.956424 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 358/742] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:01 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1336 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:02.794737 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0abf93e4-a80f-4eb8-9c2b-ec8cb0c99a51 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:02.795337 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0abf93e4-a80f-4eb8-9c2b-ec8cb0c99a51 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:02.801865 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0abf93e4-a80f-4eb8-9c2b-ec8cb0c99a51 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:02.802308 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0abf93e4-a80f-4eb8-9c2b-ec8cb0c99a51 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:02.803054 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0abf93e4-a80f-4eb8-9c2b-ec8cb0c99a51 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:02.803479 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0abf93e4-a80f-4eb8-9c2b-ec8cb0c99a51 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:02.929001 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0abf93e4-a80f-4eb8-9c2b-ec8cb0c99a51 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:02.936805 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0abf93e4-a80f-4eb8-9c2b-ec8cb0c99a51 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:02.938362 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0abf93e4-a80f-4eb8-9c2b-ec8cb0c99a51 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:02.939500 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0abf93e4-a80f-4eb8-9c2b-ec8cb0c99a51 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1725 microversion: 2.20 time: 0.148627 Jul 12 17:33:02.940072 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 385/743] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:33:02 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:33:02.972076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-50a054c2-a6cc-4e41-9926-4d8df09a72c0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:02.972773 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-50a054c2-a6cc-4e41-9926-4d8df09a72c0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:02.979142 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-50a054c2-a6cc-4e41-9926-4d8df09a72c0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:02.979593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-50a054c2-a6cc-4e41-9926-4d8df09a72c0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:02.980358 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-50a054c2-a6cc-4e41-9926-4d8df09a72c0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:02.980795 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-50a054c2-a6cc-4e41-9926-4d8df09a72c0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:03.011118 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-50a054c2-a6cc-4e41-9926-4d8df09a72c0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:03.011561 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-50a054c2-a6cc-4e41-9926-4d8df09a72c0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:03.012004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-50a054c2-a6cc-4e41-9926-4d8df09a72c0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lazy-loading 'fault' on Instance uuid 0e5af452-8518-42e8-b587-1d1fe57554c9 {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:33:03.051898 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-50a054c2-a6cc-4e41-9926-4d8df09a72c0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:03.059176 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-50a054c2-a6cc-4e41-9926-4d8df09a72c0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 200 len: 1336 microversion: 2.1 time: 0.090905 Jul 12 17:33:03.059740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 359/744] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:02 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 1336 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:03.958745 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1b8be288-af09-49ea-9cee-34d184181669 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:03.959284 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1b8be288-af09-49ea-9cee-34d184181669 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:03.965671 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1b8be288-af09-49ea-9cee-34d184181669 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:03.966173 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1b8be288-af09-49ea-9cee-34d184181669 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:03.966935 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1b8be288-af09-49ea-9cee-34d184181669 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:03.967364 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1b8be288-af09-49ea-9cee-34d184181669 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:04.076539 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4960f8db-d45e-4548-aa1f-70b66f67f4ef tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:04.077236 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4960f8db-d45e-4548-aa1f-70b66f67f4ef tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: 0e5af452-8518-42e8-b587-1d1fe57554c9] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:04.083395 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4960f8db-d45e-4548-aa1f-70b66f67f4ef tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:04.083918 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4960f8db-d45e-4548-aa1f-70b66f67f4ef tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:04.084823 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4960f8db-d45e-4548-aa1f-70b66f67f4ef tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:04.085304 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4960f8db-d45e-4548-aa1f-70b66f67f4ef tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:04.099421 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-4960f8db-d45e-4548-aa1f-70b66f67f4ef tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] HTTP exception thrown: Instance 0e5af452-8518-42e8-b587-1d1fe57554c9 could not be found. Jul 12 17:33:04.102657 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1b8be288-af09-49ea-9cee-34d184181669 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:04.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4960f8db-d45e-4548-aa1f-70b66f67f4ef tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Request method failure captured: Jul 12 17:33:04.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 HTTP/1.1 Jul 12 17:33:04.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:33:04.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:33:04.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:33:04.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:33:04.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:33:04.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:33:04.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:33:04.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:33:04.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza6rtSgQfpSEtZ33IwhEqpKxmMGz09pu5YbdTNTT6Fheask6iWh4UHUt4FI8V1LgyIrpYykgBodOOWWf2Mu8K7Zj7tYnj7ZacrJDVDubl2Llq3NDzasM5K4t3A3ipyRv-AeEDGWJXxr1RuzCzLapbei7evPQzraouwzSNqwP_LaByJ8 Jul 12 17:33:04.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:33:04.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:33:04.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:33:04.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:33:04.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:33:04.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:33:04.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: 13884af024db42bcb013e475df0a53f0 Jul 12 17:33:04.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-425710136 Jul 12 17:33:04.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:33:04.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:33:04.104445 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/13884af024db42bcb013e475df0a53f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/13884af024db42bcb013e475df0a53f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/13884af024db42bcb013e475df0a53f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_13884af024db42bcb013e475df0a53f0", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:33:04.104445 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-ServerRescueNegativeTestJSON-425710136 Jul 12 17:33:04.104445 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 13884af024db42bcb013e475df0a53f0 Jul 12 17:33:04.104445 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-425710136 Jul 12 17:33:04.104445 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-ServerRescueNegativeTestJSON-425710136-project Jul 12 17:33:04.104445 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:33:04.104445 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:33:04.104445 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: 35e0364ccc1d4992932e8483e3f1f9d6 Jul 12 17:33:04.104445 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-ServerRescueNegativeTestJSON-425710136-project Jul 12 17:33:04.104445 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:33:04.104445 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance 0e5af452-8518-42e8-b587-1d1fe57554c9 could not be found. Jul 12 17:33:04.104445 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': '0e5af452-8518-42e8-b587-1d1fe57554c9'} Jul 12 17:33:04.105396 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:33:04.105396 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:33:04.105396 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:33:04.105396 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:33:04.105396 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:33:04.105396 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:33:04.105396 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:33:04.105396 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:33:04.105396 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:33:04.105396 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:33:04.105396 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e5af452-8518-42e8-b587-1d1fe57554c9 could not be found. Jul 12 17:33:04.105396 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:33:04.105396 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:33:04.105396 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:33:04.105396 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:33:04.105396 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:33:04.105396 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:33:04.105396 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:33:04.105396 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:33:04.105396 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:33:04.106756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:33:04.106756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:33:04.106756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:33:04.106756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:33:04.106756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:33:04.106756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:33:04.106756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:33:04.106756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e5af452-8518-42e8-b587-1d1fe57554c9 could not be found. Jul 12 17:33:04.106756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:33:04.106756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:33:04.106756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:33:04.106756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:33:04.106756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:33:04.106756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:33:04.106756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:33:04.106756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:33:04.106756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e5af452-8518-42e8-b587-1d1fe57554c9 could not be found. Jul 12 17:33:04.106756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:33:04.107861 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4960f8db-d45e-4548-aa1f-70b66f67f4ef tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Returning 404 to user: Instance 0e5af452-8518-42e8-b587-1d1fe57554c9 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:33:04.107861 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4960f8db-d45e-4548-aa1f-70b66f67f4ef tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9" status: 404 len: 111 microversion: 2.1 time: 0.032824 Jul 12 17:33:04.107861 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 360/745] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:04 2022] GET /compute/v2.1/servers/0e5af452-8518-42e8-b587-1d1fe57554c9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:33:04.114211 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5d1c60bd-188d-4335-a77d-4e7ade649454 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '.version_select at 0x7f872988e160>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:04.116503 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1b8be288-af09-49ea-9cee-34d184181669 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:04.118167 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1b8be288-af09-49ea-9cee-34d184181669 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:04.119449 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1b8be288-af09-49ea-9cee-34d184181669 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1725 microversion: 2.20 time: 0.164900 Jul 12 17:33:04.120120 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 386/746] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:33:03 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:33:04.137248 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5d1c60bd-188d-4335-a77d-4e7ade649454 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1054306173" status: 202 len: 0 microversion: 2.1 time: 0.027094 Jul 12 17:33:04.137860 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 361/747] 10.222.0.62 () {58 vars in 1220 bytes} [Tue Jul 12 17:33:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1054306173 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 17:33:05.138902 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-017bc74b-3184-46db-b105-0a9649b4d9d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:05.139510 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-017bc74b-3184-46db-b105-0a9649b4d9d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:05.148513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-017bc74b-3184-46db-b105-0a9649b4d9d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:05.148967 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-017bc74b-3184-46db-b105-0a9649b4d9d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:05.149758 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-017bc74b-3184-46db-b105-0a9649b4d9d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:05.150282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-017bc74b-3184-46db-b105-0a9649b4d9d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:05.261958 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-017bc74b-3184-46db-b105-0a9649b4d9d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:05.271576 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-017bc74b-3184-46db-b105-0a9649b4d9d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:05.273151 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-017bc74b-3184-46db-b105-0a9649b4d9d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:05.274435 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-017bc74b-3184-46db-b105-0a9649b4d9d6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 200 len: 1657 microversion: 2.20 time: 0.139474 Jul 12 17:33:05.275075 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 387/748] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:33:05 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 1657 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:33:05.476312 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-169af09e-e75a-4034-a41a-af06480f4ca9 req-5f8e2ec8-036f-4d72-ad97-36be3bb99707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b5e50f-5079-438b-ac33-67623b4428f5", "name": "network-vif-deleted", "tag": "e0dd8828-dbc7-4d01-9d3f-ee997fb3d5ce"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:33:05.489707 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-169af09e-e75a-4034-a41a-af06480f4ca9 req-5f8e2ec8-036f-4d72-ad97-36be3bb99707 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:05.490202 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-169af09e-e75a-4034-a41a-af06480f4ca9 req-5f8e2ec8-036f-4d72-ad97-36be3bb99707 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:05.502330 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-169af09e-e75a-4034-a41a-af06480f4ca9 req-5f8e2ec8-036f-4d72-ad97-36be3bb99707 service nova] Creating event network-vif-deleted:e0dd8828-dbc7-4d01-9d3f-ee997fb3d5ce for instance 48b5e50f-5079-438b-ac33-67623b4428f5 on hv-cinder-84932 Jul 12 17:33:05.508250 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-169af09e-e75a-4034-a41a-af06480f4ca9 req-5f8e2ec8-036f-4d72-ad97-36be3bb99707 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035850 Jul 12 17:33:05.509573 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 362/749] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:33:05.845574 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-23bca66f-e8f4-422e-8cb1-35224ca6015e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-472588612", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-230823032", "security_groups": [{"name": "tempest-secgroup-smoke-1528447611"}], "networks": [{"uuid": "fed4962f-8432-4b33-952c-e8053c6a5d3d"}], "block_device_mapping_v2": [{"uuid": "21884bf6-841b-42b0-b7f1-057293febdff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:33:05.966369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-23bca66f-e8f4-422e-8cb1-35224ca6015e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] validate_networks() for [('fed4962f-8432-4b33-952c-e8053c6a5d3d', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:33:06.300896 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-bd34b0dd-708d-4294-9047-a09a0891d1cc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:06.301785 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-bd34b0dd-708d-4294-9047-a09a0891d1cc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:06.309033 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bd34b0dd-708d-4294-9047-a09a0891d1cc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:06.309865 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bd34b0dd-708d-4294-9047-a09a0891d1cc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:06.310734 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bd34b0dd-708d-4294-9047-a09a0891d1cc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:06.311270 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bd34b0dd-708d-4294-9047-a09a0891d1cc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:06.326760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-bd34b0dd-708d-4294-9047-a09a0891d1cc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] HTTP exception thrown: Instance 48b5e50f-5079-438b-ac33-67623b4428f5 could not be found. Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-bd34b0dd-708d-4294-9047-a09a0891d1cc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Request method failure captured: Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 HTTP/1.1 Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza8YWCq6igHxkDwkgh4oavPD182z4-F2IEhGSz-TaeAD8ZZzMxigLg6gYeCMYCTd914ppxmhU5Oxa7RORu-eETY3-krDgfFrxFFLeG7uePmey9a-HRjBVjOM1QxDuVIIBWmAbEq019sqt749QhT6o5MV0jMm5wUT2Dao5f_KVZ9NAII Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: a47989251b16474f830f5a46efe33812 Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-110492675 Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:33:06.328586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:33:06.330096 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a47989251b16474f830f5a46efe33812"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a47989251b16474f830f5a46efe33812"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a47989251b16474f830f5a46efe33812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a47989251b16474f830f5a46efe33812", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:33:06.330096 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeShelveTestJSON-110492675 Jul 12 17:33:06.330096 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: a47989251b16474f830f5a46efe33812 Jul 12 17:33:06.330096 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-110492675 Jul 12 17:33:06.330096 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeShelveTestJSON-110492675-project Jul 12 17:33:06.330096 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:33:06.330096 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:33:06.330096 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: 673bd0c57ab842f4925c770c8959354d Jul 12 17:33:06.330096 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeShelveTestJSON-110492675-project Jul 12 17:33:06.330096 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:33:06.330096 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance 48b5e50f-5079-438b-ac33-67623b4428f5 could not be found. Jul 12 17:33:06.330096 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': '48b5e50f-5079-438b-ac33-67623b4428f5'} Jul 12 17:33:06.330941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:33:06.330941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:33:06.330941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:33:06.330941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:33:06.330941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:33:06.330941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:33:06.330941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:33:06.330941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:33:06.330941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:33:06.330941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:33:06.330941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48b5e50f-5079-438b-ac33-67623b4428f5 could not be found. Jul 12 17:33:06.330941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:33:06.330941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:33:06.330941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:33:06.330941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:33:06.330941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:33:06.330941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:33:06.330941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:33:06.330941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:33:06.330941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:33:06.332169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:33:06.332169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:33:06.332169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:33:06.332169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:33:06.332169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:33:06.332169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:33:06.332169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:33:06.332169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48b5e50f-5079-438b-ac33-67623b4428f5 could not be found. Jul 12 17:33:06.332169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:33:06.332169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:33:06.332169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:33:06.332169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:33:06.332169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:33:06.332169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:33:06.332169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:33:06.332169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:33:06.332169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48b5e50f-5079-438b-ac33-67623b4428f5 could not be found. Jul 12 17:33:06.332169 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:33:06.333274 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-bd34b0dd-708d-4294-9047-a09a0891d1cc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Returning 404 to user: Instance 48b5e50f-5079-438b-ac33-67623b4428f5 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:33:06.333274 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-bd34b0dd-708d-4294-9047-a09a0891d1cc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 404 len: 111 microversion: 2.20 time: 0.041164 Jul 12 17:33:06.334460 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 363/750] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:33:06 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 17:33:06.339836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d745f078-d252-4afa-b57f-e7705464389d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '.version_select at 0x7f87297d8ca0>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:06.368333 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d745f078-d252-4afa-b57f-e7705464389d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1005991805" status: 204 len: 0 microversion: 2.20 time: 0.030684 Jul 12 17:33:06.370872 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 364/751] 10.222.0.62 () {60 vars in 1261 bytes} [Tue Jul 12 17:33:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1005991805 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 17:33:06.742174 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-23bca66f-e8f4-422e-8cb1-35224ca6015e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:33:06.742659 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-23bca66f-e8f4-422e-8cb1-35224ca6015e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:33:06.743046 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-23bca66f-e8f4-422e-8cb1-35224ca6015e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:33:06.743446 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-23bca66f-e8f4-422e-8cb1-35224ca6015e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:33:06.743849 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-23bca66f-e8f4-422e-8cb1-35224ca6015e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:33:06.753869 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-23bca66f-e8f4-422e-8cb1-35224ca6015e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:06.754354 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-23bca66f-e8f4-422e-8cb1-35224ca6015e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:06.755145 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-23bca66f-e8f4-422e-8cb1-35224ca6015e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:06.755571 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-23bca66f-e8f4-422e-8cb1-35224ca6015e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:06.763349 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:06.777246 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-23bca66f-e8f4-422e-8cb1-35224ca6015e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Getting quotas for project 6a054b68c85844739e5df76de96a12e7. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:33:06.781820 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-23bca66f-e8f4-422e-8cb1-35224ca6015e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Getting quotas for user 5bd18bd359544360af0956a4567cf09d and project 6a054b68c85844739e5df76de96a12e7. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:33:06.838707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-23bca66f-e8f4-422e-8cb1-35224ca6015e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:33:06.840842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-23bca66f-e8f4-422e-8cb1-35224ca6015e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='21884bf6-841b-42b0-b7f1-057293febdff',volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:33:06.969292 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-23bca66f-e8f4-422e-8cb1-35224ca6015e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.126987 Jul 12 17:33:06.970215 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 388/752] 10.222.0.62 () {60 vars in 1146 bytes} [Tue Jul 12 17:33:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:33:06.980734 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-56043491-4dcf-4622-a099-2a09d542dc76 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:06.981441 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-56043491-4dcf-4622-a099-2a09d542dc76 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:07.039865 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-56043491-4dcf-4622-a099-2a09d542dc76 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:07.048375 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-56043491-4dcf-4622-a099-2a09d542dc76 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1087 microversion: 2.1 time: 0.071677 Jul 12 17:33:07.050029 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 365/753] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:06 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1087 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:07.085544 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-614f265c-4c54-42e0-a40a-6364c9fb6e81 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Action: 'create', calling method: .version_select at 0x7f8729a001f0>, body: {"keypair": {"name": "tempest-keypair-625185159", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgmE7XqmxWC7PcrMlvT/9efpBRe7L66as2p1WyI31dg3e5C0U3ba+y1AvZb50LvxrlkqRZqVDhISy99NBJEONmVkSVIArpwZ08wqYPZ5LABYkRtd/hzQdDZ43ZlPzYbxw=="}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:33:07.099426 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-614f265c-4c54-42e0-a40a-6364c9fb6e81 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Getting quotas for project a47989251b16474f830f5a46efe33812. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:33:07.103253 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-614f265c-4c54-42e0-a40a-6364c9fb6e81 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Getting quotas for user 673bd0c57ab842f4925c770c8959354d and project a47989251b16474f830f5a46efe33812. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:33:07.129325 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-614f265c-4c54-42e0-a40a-6364c9fb6e81 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047722 Jul 12 17:33:07.129941 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 389/754] 10.222.0.62 () {62 vars in 1199 bytes} [Tue Jul 12 17:33:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 17:33:07.461574 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-95cf4259-ed74-4d87-996a-e5b1021b2360 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:07.462174 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-95cf4259-ed74-4d87-996a-e5b1021b2360 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:07.468269 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-95cf4259-ed74-4d87-996a-e5b1021b2360 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:07.468827 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-95cf4259-ed74-4d87-996a-e5b1021b2360 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:07.469988 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-95cf4259-ed74-4d87-996a-e5b1021b2360 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:07.470646 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-95cf4259-ed74-4d87-996a-e5b1021b2360 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:07.503379 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-95cf4259-ed74-4d87-996a-e5b1021b2360 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Going to try to terminate instance {{(pid=117939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:33:07.517463 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:07.589877 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-95cf4259-ed74-4d87-996a-e5b1021b2360 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 204 len: 0 microversion: 2.1 time: 0.131757 Jul 12 17:33:07.590704 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 366/755] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:33:07 2022] DELETE /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 17:33:07.598891 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b28b7be5-2609-486b-9a5e-25ed1c5a3ab2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:07.599942 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b28b7be5-2609-486b-9a5e-25ed1c5a3ab2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:07.608848 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b28b7be5-2609-486b-9a5e-25ed1c5a3ab2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:07.610131 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b28b7be5-2609-486b-9a5e-25ed1c5a3ab2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:07.611147 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b28b7be5-2609-486b-9a5e-25ed1c5a3ab2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:07.611776 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b28b7be5-2609-486b-9a5e-25ed1c5a3ab2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:07.838430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b28b7be5-2609-486b-9a5e-25ed1c5a3ab2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:07.845986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b28b7be5-2609-486b-9a5e-25ed1c5a3ab2 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1508 microversion: 2.1 time: 0.251341 Jul 12 17:33:07.847048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 390/756] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:07 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1508 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:08.068172 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-414b7433-d66a-4e6a-865f-397b1adc1cd3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:08.068691 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-414b7433-d66a-4e6a-865f-397b1adc1cd3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:08.077792 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-414b7433-d66a-4e6a-865f-397b1adc1cd3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:08.078496 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-414b7433-d66a-4e6a-865f-397b1adc1cd3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:08.079271 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-414b7433-d66a-4e6a-865f-397b1adc1cd3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:08.079724 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-414b7433-d66a-4e6a-865f-397b1adc1cd3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:08.152206 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-414b7433-d66a-4e6a-865f-397b1adc1cd3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:08.160561 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-414b7433-d66a-4e6a-865f-397b1adc1cd3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1185 microversion: 2.1 time: 0.097518 Jul 12 17:33:08.161187 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 367/757] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:08 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:08.489713 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d39cb180-ebe8-4c15-bd4e-c89c8367f7e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-766819090", "imageRef": "b19e7830-75c9-4706-bd34-4954ba6b4cc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f555be57-c537-4463-873d-2fa611295c76"}], "security_groups": [{"name": "tempest-securitygroup--1276005796"}], "key_name": "tempest-keypair-625185159", "user_data": "}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:33:08.696144 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-d39cb180-ebe8-4c15-bd4e-c89c8367f7e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] validate_networks() for [('f555be57-c537-4463-873d-2fa611295c76', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:33:08.864051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-fdfe31d8-f352-4a56-837f-a2b219037ecc tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:08.864612 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-fdfe31d8-f352-4a56-837f-a2b219037ecc tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:08.870535 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fdfe31d8-f352-4a56-837f-a2b219037ecc tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:08.870982 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fdfe31d8-f352-4a56-837f-a2b219037ecc tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:08.871740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fdfe31d8-f352-4a56-837f-a2b219037ecc tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:08.872170 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fdfe31d8-f352-4a56-837f-a2b219037ecc tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:09.287711 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fdfe31d8-f352-4a56-837f-a2b219037ecc tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:09.296020 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-fdfe31d8-f352-4a56-837f-a2b219037ecc tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1508 microversion: 2.1 time: 0.436495 Jul 12 17:33:09.296609 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 368/758] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:08 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1508 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:33:09.302034 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4d92e02b-af21-4b44-b2c3-3e7148ec46b9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:09.302845 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4d92e02b-af21-4b44-b2c3-3e7148ec46b9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:09.309650 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4d92e02b-af21-4b44-b2c3-3e7148ec46b9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:09.310230 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4d92e02b-af21-4b44-b2c3-3e7148ec46b9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:09.311007 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4d92e02b-af21-4b44-b2c3-3e7148ec46b9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:09.311441 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4d92e02b-af21-4b44-b2c3-3e7148ec46b9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:09.413388 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4d92e02b-af21-4b44-b2c3-3e7148ec46b9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:09.420945 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4d92e02b-af21-4b44-b2c3-3e7148ec46b9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1203 microversion: 2.1 time: 0.123365 Jul 12 17:33:09.421518 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 369/759] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:09 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1203 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:09.664008 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-d39cb180-ebe8-4c15-bd4e-c89c8367f7e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:33:09.664515 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-d39cb180-ebe8-4c15-bd4e-c89c8367f7e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:33:09.664942 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-d39cb180-ebe8-4c15-bd4e-c89c8367f7e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:33:09.665348 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-d39cb180-ebe8-4c15-bd4e-c89c8367f7e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:33:09.665790 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-d39cb180-ebe8-4c15-bd4e-c89c8367f7e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:33:09.675039 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d39cb180-ebe8-4c15-bd4e-c89c8367f7e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:09.675492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d39cb180-ebe8-4c15-bd4e-c89c8367f7e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:09.676265 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d39cb180-ebe8-4c15-bd4e-c89c8367f7e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:09.676721 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d39cb180-ebe8-4c15-bd4e-c89c8367f7e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:09.694783 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-d39cb180-ebe8-4c15-bd4e-c89c8367f7e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Getting quotas for project a47989251b16474f830f5a46efe33812. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:33:09.698472 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-d39cb180-ebe8-4c15-bd4e-c89c8367f7e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Getting quotas for user 673bd0c57ab842f4925c770c8959354d and project a47989251b16474f830f5a46efe33812. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:33:09.710221 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d39cb180-ebe8-4c15-bd4e-c89c8367f7e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:33:09.712323 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d39cb180-ebe8-4c15-bd4e-c89c8367f7e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19e7830-75c9-4706-bd34-4954ba6b4cc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:33:09.761880 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d39cb180-ebe8-4c15-bd4e-c89c8367f7e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.276918 Jul 12 17:33:09.762851 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 391/760] 10.222.0.62 () {62 vars in 1187 bytes} [Tue Jul 12 17:33:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 1279 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 17:33:09.771534 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-f72ddb37-518c-4867-87a5-0196be3f338f req-f7788eef-5a5e-4a8b-8285-d040165ce20c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4b5fa1-33f6-4da9-9411-e89b13939d30", "name": "network-vif-deleted", "tag": "3616dee8-6bc4-4fb6-b034-e3ea6a8c7adc"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:33:09.776607 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f66fbccd-a82f-428c-b347-5dc5ce66fb8b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:09.777297 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f66fbccd-a82f-428c-b347-5dc5ce66fb8b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:09.785085 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-f72ddb37-518c-4867-87a5-0196be3f338f req-f7788eef-5a5e-4a8b-8285-d040165ce20c service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:09.786068 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-f72ddb37-518c-4867-87a5-0196be3f338f req-f7788eef-5a5e-4a8b-8285-d040165ce20c service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:09.814397 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-f72ddb37-518c-4867-87a5-0196be3f338f req-f7788eef-5a5e-4a8b-8285-d040165ce20c service nova] Creating event network-vif-deleted:3616dee8-6bc4-4fb6-b034-e3ea6a8c7adc for instance cc4b5fa1-33f6-4da9-9411-e89b13939d30 on hv-cinder-84932 Jul 12 17:33:09.827469 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-f72ddb37-518c-4867-87a5-0196be3f338f req-f7788eef-5a5e-4a8b-8285-d040165ce20c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064237 Jul 12 17:33:09.828657 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 370/761] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:33:09.875403 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f66fbccd-a82f-428c-b347-5dc5ce66fb8b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:09.886620 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f66fbccd-a82f-428c-b347-5dc5ce66fb8b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:09.888737 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f66fbccd-a82f-428c-b347-5dc5ce66fb8b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:09.893873 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f66fbccd-a82f-428c-b347-5dc5ce66fb8b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1280 microversion: 2.20 time: 0.123061 Jul 12 17:33:09.897736 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 392/762] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:33:09 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1280 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:33:10.317404 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f7c3671c-7a8e-4a34-b45a-764d8a81068c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:10.318393 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f7c3671c-7a8e-4a34-b45a-764d8a81068c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:10.325483 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f7c3671c-7a8e-4a34-b45a-764d8a81068c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:10.326204 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f7c3671c-7a8e-4a34-b45a-764d8a81068c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:10.327356 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f7c3671c-7a8e-4a34-b45a-764d8a81068c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:10.327603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f7c3671c-7a8e-4a34-b45a-764d8a81068c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:10.362744 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f7c3671c-7a8e-4a34-b45a-764d8a81068c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:10.363193 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f7c3671c-7a8e-4a34-b45a-764d8a81068c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:10.363644 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-f7c3671c-7a8e-4a34-b45a-764d8a81068c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lazy-loading 'fault' on Instance uuid cc4b5fa1-33f6-4da9-9411-e89b13939d30 {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:33:10.419140 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f7c3671c-7a8e-4a34-b45a-764d8a81068c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:10.429304 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f7c3671c-7a8e-4a34-b45a-764d8a81068c tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 200 len: 1312 microversion: 2.1 time: 0.120537 Jul 12 17:33:10.430157 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 371/763] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:10 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 1312 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:10.438397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0cf72285-c1ef-4f02-a2fe-f5c121625826 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:10.439114 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0cf72285-c1ef-4f02-a2fe-f5c121625826 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:10.447565 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0cf72285-c1ef-4f02-a2fe-f5c121625826 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:10.448011 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0cf72285-c1ef-4f02-a2fe-f5c121625826 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:10.448834 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0cf72285-c1ef-4f02-a2fe-f5c121625826 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:10.449365 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0cf72285-c1ef-4f02-a2fe-f5c121625826 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:10.664825 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0cf72285-c1ef-4f02-a2fe-f5c121625826 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:10.672450 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0cf72285-c1ef-4f02-a2fe-f5c121625826 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1259 microversion: 2.1 time: 0.238011 Jul 12 17:33:10.682592 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 393/764] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:10 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1259 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:10.913677 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d0f620d8-c463-41f9-9f98-20f42f41a1ec tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:10.914313 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d0f620d8-c463-41f9-9f98-20f42f41a1ec tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:10.926105 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d0f620d8-c463-41f9-9f98-20f42f41a1ec tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:10.926703 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d0f620d8-c463-41f9-9f98-20f42f41a1ec tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:10.927508 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d0f620d8-c463-41f9-9f98-20f42f41a1ec tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:10.927961 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d0f620d8-c463-41f9-9f98-20f42f41a1ec tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:11.234861 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d0f620d8-c463-41f9-9f98-20f42f41a1ec tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:11.243248 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d0f620d8-c463-41f9-9f98-20f42f41a1ec tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:11.244740 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d0f620d8-c463-41f9-9f98-20f42f41a1ec tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:11.245860 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d0f620d8-c463-41f9-9f98-20f42f41a1ec tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1340 microversion: 2.20 time: 0.336164 Jul 12 17:33:11.246413 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 372/765] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:33:10 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1340 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:33:11.446728 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0cf917d0-e247-4bd6-8190-62daec26182d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:11.447503 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0cf917d0-e247-4bd6-8190-62daec26182d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: cc4b5fa1-33f6-4da9-9411-e89b13939d30] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:11.454579 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0cf917d0-e247-4bd6-8190-62daec26182d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:11.455140 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0cf917d0-e247-4bd6-8190-62daec26182d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:11.456949 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0cf917d0-e247-4bd6-8190-62daec26182d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:11.457728 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0cf917d0-e247-4bd6-8190-62daec26182d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:11.473414 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-0cf917d0-e247-4bd6-8190-62daec26182d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] HTTP exception thrown: Instance cc4b5fa1-33f6-4da9-9411-e89b13939d30 could not be found. Jul 12 17:33:11.475213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0cf917d0-e247-4bd6-8190-62daec26182d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Request method failure captured: Jul 12 17:33:11.475213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 HTTP/1.1 Jul 12 17:33:11.475213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:33:11.475213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:33:11.475213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:33:11.475213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:33:11.475213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:33:11.475213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:33:11.475213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:33:11.475213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:33:11.475213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza6rtSgQfpSEtZ33IwhEqpKxmMGz09pu5YbdTNTT6Fheask6iWh4UHUt4FI8V1LgyIrpYykgBodOOWWf2Mu8K7Zj7tYnj7ZacrJDVDubl2Llq3NDzasM5K4t3A3ipyRv-AeEDGWJXxr1RuzCzLapbei7evPQzraouwzSNqwP_LaByJ8 Jul 12 17:33:11.475213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:33:11.475213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:33:11.475213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:33:11.475213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:33:11.475213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:33:11.475213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:33:11.475213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: 13884af024db42bcb013e475df0a53f0 Jul 12 17:33:11.475213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-425710136 Jul 12 17:33:11.475213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:33:11.475213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:33:11.476782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/13884af024db42bcb013e475df0a53f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/13884af024db42bcb013e475df0a53f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/13884af024db42bcb013e475df0a53f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_13884af024db42bcb013e475df0a53f0", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:33:11.476782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-ServerRescueNegativeTestJSON-425710136 Jul 12 17:33:11.476782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 13884af024db42bcb013e475df0a53f0 Jul 12 17:33:11.476782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-425710136 Jul 12 17:33:11.476782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-ServerRescueNegativeTestJSON-425710136-project Jul 12 17:33:11.476782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:33:11.476782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:33:11.476782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: 35e0364ccc1d4992932e8483e3f1f9d6 Jul 12 17:33:11.476782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-ServerRescueNegativeTestJSON-425710136-project Jul 12 17:33:11.476782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:33:11.476782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Instance cc4b5fa1-33f6-4da9-9411-e89b13939d30 could not be found. Jul 12 17:33:11.476782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': 'cc4b5fa1-33f6-4da9-9411-e89b13939d30'} Jul 12 17:33:11.477767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:33:11.477767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:33:11.477767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:33:11.477767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:33:11.477767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:33:11.477767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:33:11.477767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:33:11.477767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:33:11.477767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:33:11.477767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:33:11.477767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc4b5fa1-33f6-4da9-9411-e89b13939d30 could not be found. Jul 12 17:33:11.477767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:33:11.477767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:33:11.477767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:33:11.477767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:33:11.477767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:33:11.477767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:33:11.477767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:33:11.477767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:33:11.477767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:33:11.479209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:33:11.479209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:33:11.479209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:33:11.479209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:33:11.479209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:33:11.479209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:33:11.479209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:33:11.479209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc4b5fa1-33f6-4da9-9411-e89b13939d30 could not be found. Jul 12 17:33:11.479209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:33:11.479209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:33:11.479209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:33:11.479209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:33:11.479209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:33:11.479209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:33:11.479209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:33:11.479209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:33:11.479209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc4b5fa1-33f6-4da9-9411-e89b13939d30 could not be found. Jul 12 17:33:11.479209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:33:11.481041 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0cf917d0-e247-4bd6-8190-62daec26182d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Returning 404 to user: Instance cc4b5fa1-33f6-4da9-9411-e89b13939d30 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:33:11.481041 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0cf917d0-e247-4bd6-8190-62daec26182d tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30" status: 404 len: 111 microversion: 2.1 time: 0.035387 Jul 12 17:33:11.481041 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 394/766] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:11 2022] GET /compute/v2.1/servers/cc4b5fa1-33f6-4da9-9411-e89b13939d30 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:33:11.488923 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-99e52934-3059-4826-b1f9-f879d42d753b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:11.489418 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-99e52934-3059-4826-b1f9-f879d42d753b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:11.497236 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-99e52934-3059-4826-b1f9-f879d42d753b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:11.498014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-99e52934-3059-4826-b1f9-f879d42d753b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:11.498841 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-99e52934-3059-4826-b1f9-f879d42d753b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:11.499444 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-99e52934-3059-4826-b1f9-f879d42d753b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:11.527810 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-99e52934-3059-4826-b1f9-f879d42d753b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Going to try to terminate instance {{(pid=117939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:33:11.613677 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-99e52934-3059-4826-b1f9-f879d42d753b tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 204 len: 0 microversion: 2.1 time: 0.129182 Jul 12 17:33:11.614713 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 373/767] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:33:11 2022] DELETE /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:33:11.622879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-facb80d5-c63f-459d-ba92-542d07e73426 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:11.623664 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-facb80d5-c63f-459d-ba92-542d07e73426 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:11.629799 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-facb80d5-c63f-459d-ba92-542d07e73426 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:11.630244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-facb80d5-c63f-459d-ba92-542d07e73426 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:11.631326 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-facb80d5-c63f-459d-ba92-542d07e73426 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:11.632303 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-facb80d5-c63f-459d-ba92-542d07e73426 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:11.692266 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-80615557-b5ae-4c67-b5d0-27ab145bdc97 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:11.693223 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-80615557-b5ae-4c67-b5d0-27ab145bdc97 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:11.699312 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-80615557-b5ae-4c67-b5d0-27ab145bdc97 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:11.699760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-80615557-b5ae-4c67-b5d0-27ab145bdc97 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:11.700527 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-80615557-b5ae-4c67-b5d0-27ab145bdc97 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:11.700961 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-80615557-b5ae-4c67-b5d0-27ab145bdc97 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:11.908300 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-facb80d5-c63f-459d-ba92-542d07e73426 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:11.917107 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-facb80d5-c63f-459d-ba92-542d07e73426 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.298465 Jul 12 17:33:11.917703 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 395/768] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:11 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:11.922119 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-44acb7fd-4874-4273-80ef-c7f5795f6029 req-e0f88bbd-c544-4739-856f-1b853c8d3166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdfd07ca-55f6-48b2-b2c7-f202196e05ed", "tag": "78ee797f-f3e0-4e02-ba3d-1c9755d72b65"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:33:11.930233 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-44acb7fd-4874-4273-80ef-c7f5795f6029 req-e0f88bbd-c544-4739-856f-1b853c8d3166 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:11.931319 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-44acb7fd-4874-4273-80ef-c7f5795f6029 req-e0f88bbd-c544-4739-856f-1b853c8d3166 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:11.942573 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-44acb7fd-4874-4273-80ef-c7f5795f6029 req-e0f88bbd-c544-4739-856f-1b853c8d3166 service nova] Creating event network-changed:78ee797f-f3e0-4e02-ba3d-1c9755d72b65 for instance bdfd07ca-55f6-48b2-b2c7-f202196e05ed on hv-cinder-84932 Jul 12 17:33:11.947753 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-44acb7fd-4874-4273-80ef-c7f5795f6029 req-e0f88bbd-c544-4739-856f-1b853c8d3166 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028907 Jul 12 17:33:11.948626 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 396/769] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:33:11.979145 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-80615557-b5ae-4c67-b5d0-27ab145bdc97 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:11.987118 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-80615557-b5ae-4c67-b5d0-27ab145bdc97 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1259 microversion: 2.1 time: 0.298861 Jul 12 17:33:11.987817 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 374/770] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:11 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1259 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:33:12.265926 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-655832b9-dc85-40bc-8933-625ca186c7d2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:12.266492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-655832b9-dc85-40bc-8933-625ca186c7d2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:12.274404 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-655832b9-dc85-40bc-8933-625ca186c7d2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:12.275550 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-655832b9-dc85-40bc-8933-625ca186c7d2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:12.276758 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-655832b9-dc85-40bc-8933-625ca186c7d2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:12.277336 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-655832b9-dc85-40bc-8933-625ca186c7d2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:12.411371 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-655832b9-dc85-40bc-8933-625ca186c7d2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:12.419597 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-655832b9-dc85-40bc-8933-625ca186c7d2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:12.421122 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-655832b9-dc85-40bc-8933-625ca186c7d2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:12.422253 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-655832b9-dc85-40bc-8933-625ca186c7d2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1406 microversion: 2.20 time: 0.161469 Jul 12 17:33:12.422806 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 397/771] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:33:12 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:33:12.936544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7f0f7d04-bb9c-46cf-8cc7-2c6295ed2ed0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:12.937161 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7f0f7d04-bb9c-46cf-8cc7-2c6295ed2ed0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:12.943887 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f0f7d04-bb9c-46cf-8cc7-2c6295ed2ed0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:12.944341 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f0f7d04-bb9c-46cf-8cc7-2c6295ed2ed0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:12.945111 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f0f7d04-bb9c-46cf-8cc7-2c6295ed2ed0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:12.945555 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f0f7d04-bb9c-46cf-8cc7-2c6295ed2ed0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:13.003258 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-280831dc-34e8-4427-9a3f-a948cad9c597 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:13.004120 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-280831dc-34e8-4427-9a3f-a948cad9c597 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:13.007121 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:13.011454 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-280831dc-34e8-4427-9a3f-a948cad9c597 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:13.011909 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-280831dc-34e8-4427-9a3f-a948cad9c597 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:13.012709 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-280831dc-34e8-4427-9a3f-a948cad9c597 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:13.013150 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-280831dc-34e8-4427-9a3f-a948cad9c597 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:13.115196 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7f0f7d04-bb9c-46cf-8cc7-2c6295ed2ed0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:13.122731 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7f0f7d04-bb9c-46cf-8cc7-2c6295ed2ed0 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.190099 Jul 12 17:33:13.123406 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 375/772] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:12 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:13.160536 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-280831dc-34e8-4427-9a3f-a948cad9c597 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:13.168071 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-280831dc-34e8-4427-9a3f-a948cad9c597 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1259 microversion: 2.1 time: 0.168668 Jul 12 17:33:13.168632 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 398/773] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:12 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:33:13.440285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0d0d5dd7-54eb-4caa-8b96-2a1e8a9a6b0b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:13.440901 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0d0d5dd7-54eb-4caa-8b96-2a1e8a9a6b0b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:13.447197 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0d0d5dd7-54eb-4caa-8b96-2a1e8a9a6b0b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:13.447650 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0d0d5dd7-54eb-4caa-8b96-2a1e8a9a6b0b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:13.448425 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0d0d5dd7-54eb-4caa-8b96-2a1e8a9a6b0b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:13.448867 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0d0d5dd7-54eb-4caa-8b96-2a1e8a9a6b0b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:13.577335 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0d0d5dd7-54eb-4caa-8b96-2a1e8a9a6b0b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:13.586708 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0d0d5dd7-54eb-4caa-8b96-2a1e8a9a6b0b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:13.588343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0d0d5dd7-54eb-4caa-8b96-2a1e8a9a6b0b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:13.589510 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0d0d5dd7-54eb-4caa-8b96-2a1e8a9a6b0b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1406 microversion: 2.20 time: 0.153145 Jul 12 17:33:13.590475 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 376/774] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:33:13 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:33:14.139640 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cd633549-b1a5-45fc-ada5-7d68533b3ce7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:14.140249 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cd633549-b1a5-45fc-ada5-7d68533b3ce7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:14.147296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd633549-b1a5-45fc-ada5-7d68533b3ce7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:14.147836 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd633549-b1a5-45fc-ada5-7d68533b3ce7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:14.148782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd633549-b1a5-45fc-ada5-7d68533b3ce7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:14.149417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd633549-b1a5-45fc-ada5-7d68533b3ce7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:14.188420 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-941d3c3a-8de7-4c52-a157-56432b6b1a46 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:14.189649 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-941d3c3a-8de7-4c52-a157-56432b6b1a46 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:14.198040 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-941d3c3a-8de7-4c52-a157-56432b6b1a46 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:14.198767 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-941d3c3a-8de7-4c52-a157-56432b6b1a46 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:14.199718 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-941d3c3a-8de7-4c52-a157-56432b6b1a46 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:14.200313 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-941d3c3a-8de7-4c52-a157-56432b6b1a46 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:14.415758 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cd633549-b1a5-45fc-ada5-7d68533b3ce7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:14.423189 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cd633549-b1a5-45fc-ada5-7d68533b3ce7 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.287423 Jul 12 17:33:14.423953 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 399/775] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:14 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:14.469172 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-941d3c3a-8de7-4c52-a157-56432b6b1a46 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:14.476986 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-941d3c3a-8de7-4c52-a157-56432b6b1a46 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1259 microversion: 2.1 time: 0.296234 Jul 12 17:33:14.477556 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 377/776] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:14 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1259 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:14.538484 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-46050f50-aa72-41fe-b8b7-714ddf1b7fcf req-db58745c-1dae-4616-9dc3-89da7cb0f312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeedc087-222c-4452-bf37-2f152ce787a6", "tag": "c8a34f14-81f6-401c-83f7-ce051f443de8"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:33:14.546693 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-46050f50-aa72-41fe-b8b7-714ddf1b7fcf req-db58745c-1dae-4616-9dc3-89da7cb0f312 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:14.547144 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-46050f50-aa72-41fe-b8b7-714ddf1b7fcf req-db58745c-1dae-4616-9dc3-89da7cb0f312 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:14.564104 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-46050f50-aa72-41fe-b8b7-714ddf1b7fcf req-db58745c-1dae-4616-9dc3-89da7cb0f312 service nova] Creating event network-changed:c8a34f14-81f6-401c-83f7-ce051f443de8 for instance aeedc087-222c-4452-bf37-2f152ce787a6 on hv-cinder-84932 Jul 12 17:33:14.569794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-46050f50-aa72-41fe-b8b7-714ddf1b7fcf req-db58745c-1dae-4616-9dc3-89da7cb0f312 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035187 Jul 12 17:33:14.571661 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 400/777] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:33:14.607543 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-60c0d5da-d0f2-4fc7-a7ac-8f2b329b502a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:14.608158 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-60c0d5da-d0f2-4fc7-a7ac-8f2b329b502a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:14.614385 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-60c0d5da-d0f2-4fc7-a7ac-8f2b329b502a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:14.614837 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-60c0d5da-d0f2-4fc7-a7ac-8f2b329b502a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:14.615623 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-60c0d5da-d0f2-4fc7-a7ac-8f2b329b502a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:14.616063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-60c0d5da-d0f2-4fc7-a7ac-8f2b329b502a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:14.753116 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-60c0d5da-d0f2-4fc7-a7ac-8f2b329b502a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:14.762148 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-60c0d5da-d0f2-4fc7-a7ac-8f2b329b502a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:14.763679 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-60c0d5da-d0f2-4fc7-a7ac-8f2b329b502a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:14.764779 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-60c0d5da-d0f2-4fc7-a7ac-8f2b329b502a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1406 microversion: 2.20 time: 0.161179 Jul 12 17:33:14.769460 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 378/778] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:33:14 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:33:15.440990 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d927fa68-ebb5-46ab-99d8-6034640b01ac tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:15.441712 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d927fa68-ebb5-46ab-99d8-6034640b01ac tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:15.448467 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d927fa68-ebb5-46ab-99d8-6034640b01ac tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:15.448917 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d927fa68-ebb5-46ab-99d8-6034640b01ac tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:15.449711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d927fa68-ebb5-46ab-99d8-6034640b01ac tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:15.450152 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d927fa68-ebb5-46ab-99d8-6034640b01ac tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:15.493303 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0ac823c5-56a9-486e-be77-2ca0bd3057c3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:15.493971 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0ac823c5-56a9-486e-be77-2ca0bd3057c3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:15.500571 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0ac823c5-56a9-486e-be77-2ca0bd3057c3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:15.501025 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0ac823c5-56a9-486e-be77-2ca0bd3057c3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:15.502014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0ac823c5-56a9-486e-be77-2ca0bd3057c3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:15.503077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0ac823c5-56a9-486e-be77-2ca0bd3057c3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:15.830505 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d927fa68-ebb5-46ab-99d8-6034640b01ac tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:15.839664 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d927fa68-ebb5-46ab-99d8-6034640b01ac tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1521 microversion: 2.1 time: 0.402938 Jul 12 17:33:15.840598 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 401/779] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:15 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:15.846845 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fc62e9e6-a9e2-46a5-82e8-497b78525e08 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:15.847546 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fc62e9e6-a9e2-46a5-82e8-497b78525e08 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:15.853770 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fc62e9e6-a9e2-46a5-82e8-497b78525e08 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:15.854339 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fc62e9e6-a9e2-46a5-82e8-497b78525e08 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:15.855207 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fc62e9e6-a9e2-46a5-82e8-497b78525e08 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:15.856377 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fc62e9e6-a9e2-46a5-82e8-497b78525e08 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:15.880965 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0ac823c5-56a9-486e-be77-2ca0bd3057c3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:15.889732 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0ac823c5-56a9-486e-be77-2ca0bd3057c3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1259 microversion: 2.1 time: 0.399764 Jul 12 17:33:15.890727 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 379/780] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:15 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1259 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:33:16.123712 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fc62e9e6-a9e2-46a5-82e8-497b78525e08 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:16.131945 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fc62e9e6-a9e2-46a5-82e8-497b78525e08 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:16.133591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fc62e9e6-a9e2-46a5-82e8-497b78525e08 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:16.134803 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fc62e9e6-a9e2-46a5-82e8-497b78525e08 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1406 microversion: 2.20 time: 0.293081 Jul 12 17:33:16.135369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 402/781] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:33:15 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1406 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:33:16.584531 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-085d4af4-4c04-476c-a4b1-88e550cd18f6 req-37155234-564b-402e-b657-e6f68eee50c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4d99e1a-efd3-4510-ac75-1c21c7937044", "name": "network-vif-deleted", "tag": "139b5be4-a836-4dac-8cf5-8f90d7599330"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:33:16.594506 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-085d4af4-4c04-476c-a4b1-88e550cd18f6 req-37155234-564b-402e-b657-e6f68eee50c3 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:16.594949 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-085d4af4-4c04-476c-a4b1-88e550cd18f6 req-37155234-564b-402e-b657-e6f68eee50c3 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:16.606826 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-085d4af4-4c04-476c-a4b1-88e550cd18f6 req-37155234-564b-402e-b657-e6f68eee50c3 service nova] Creating event network-vif-deleted:139b5be4-a836-4dac-8cf5-8f90d7599330 for instance f4d99e1a-efd3-4510-ac75-1c21c7937044 on hv-cinder-84932 Jul 12 17:33:16.612245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-085d4af4-4c04-476c-a4b1-88e550cd18f6 req-37155234-564b-402e-b657-e6f68eee50c3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031008 Jul 12 17:33:16.612852 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 380/782] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:33:16.857480 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c34b4b7a-987e-45a3-a13a-526f11c04e67 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:16.858057 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c34b4b7a-987e-45a3-a13a-526f11c04e67 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:16.864711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c34b4b7a-987e-45a3-a13a-526f11c04e67 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:16.865148 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c34b4b7a-987e-45a3-a13a-526f11c04e67 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:16.865934 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c34b4b7a-987e-45a3-a13a-526f11c04e67 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:16.866390 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c34b4b7a-987e-45a3-a13a-526f11c04e67 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:16.906872 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-24f12120-3389-4e48-aae8-b01024efcf7f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:16.907502 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-24f12120-3389-4e48-aae8-b01024efcf7f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:16.914451 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-24f12120-3389-4e48-aae8-b01024efcf7f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:16.914903 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-24f12120-3389-4e48-aae8-b01024efcf7f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:16.915680 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-24f12120-3389-4e48-aae8-b01024efcf7f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:16.916118 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-24f12120-3389-4e48-aae8-b01024efcf7f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:16.926814 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c34b4b7a-987e-45a3-a13a-526f11c04e67 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:16.933923 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:16.934127 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c34b4b7a-987e-45a3-a13a-526f11c04e67 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1479 microversion: 2.1 time: 0.080560 Jul 12 17:33:16.934841 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 403/783] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:16 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1479 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:17.045820 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:17.049912 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-24f12120-3389-4e48-aae8-b01024efcf7f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:17.057511 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-24f12120-3389-4e48-aae8-b01024efcf7f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1259 microversion: 2.1 time: 0.154974 Jul 12 17:33:17.058111 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 381/784] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:16 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:33:17.153097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-52ce1b9d-f4f1-40f6-b5ae-f854a55bb4c7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:17.153721 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-52ce1b9d-f4f1-40f6-b5ae-f854a55bb4c7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:17.162660 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-52ce1b9d-f4f1-40f6-b5ae-f854a55bb4c7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:17.163328 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-52ce1b9d-f4f1-40f6-b5ae-f854a55bb4c7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:17.164202 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-52ce1b9d-f4f1-40f6-b5ae-f854a55bb4c7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:17.164638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-52ce1b9d-f4f1-40f6-b5ae-f854a55bb4c7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:17.293477 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-52ce1b9d-f4f1-40f6-b5ae-f854a55bb4c7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:17.301290 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-52ce1b9d-f4f1-40f6-b5ae-f854a55bb4c7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:17.302804 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-52ce1b9d-f4f1-40f6-b5ae-f854a55bb4c7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:17.303895 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-52ce1b9d-f4f1-40f6-b5ae-f854a55bb4c7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1406 microversion: 2.20 time: 0.154809 Jul 12 17:33:17.304443 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 404/785] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:33:17 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:33:17.951292 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d3032c12-82d3-472c-8c9e-8ab75bf648ab tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:17.951823 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d3032c12-82d3-472c-8c9e-8ab75bf648ab tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:17.955432 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:17.959599 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d3032c12-82d3-472c-8c9e-8ab75bf648ab tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:17.960051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d3032c12-82d3-472c-8c9e-8ab75bf648ab tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:17.960814 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d3032c12-82d3-472c-8c9e-8ab75bf648ab tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:17.961256 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d3032c12-82d3-472c-8c9e-8ab75bf648ab tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:18.022218 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d3032c12-82d3-472c-8c9e-8ab75bf648ab tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e0364ccc1d4992932e8483e3f1f9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13884af024db42bcb013e475df0a53f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:18.029577 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d3032c12-82d3-472c-8c9e-8ab75bf648ab tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 200 len: 1479 microversion: 2.1 time: 0.082283 Jul 12 17:33:18.030175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 382/786] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:17 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 1479 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:18.074092 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-08a1970c-93a3-407a-a252-5db6a2cd12eb tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:18.074732 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-08a1970c-93a3-407a-a252-5db6a2cd12eb tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:18.080642 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-08a1970c-93a3-407a-a252-5db6a2cd12eb tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:18.081085 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-08a1970c-93a3-407a-a252-5db6a2cd12eb tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:18.081879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-08a1970c-93a3-407a-a252-5db6a2cd12eb tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:18.082310 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-08a1970c-93a3-407a-a252-5db6a2cd12eb tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:18.207489 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-08a1970c-93a3-407a-a252-5db6a2cd12eb tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:18.214904 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-08a1970c-93a3-407a-a252-5db6a2cd12eb tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1259 microversion: 2.1 time: 0.144583 Jul 12 17:33:18.215465 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 405/787] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:18 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:18.321707 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-15957f52-acd3-42bf-87da-7153a032404f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:18.322325 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-15957f52-acd3-42bf-87da-7153a032404f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:18.328218 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-15957f52-acd3-42bf-87da-7153a032404f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:18.328662 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-15957f52-acd3-42bf-87da-7153a032404f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:18.329405 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-15957f52-acd3-42bf-87da-7153a032404f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:18.329870 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-15957f52-acd3-42bf-87da-7153a032404f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:18.526581 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-15957f52-acd3-42bf-87da-7153a032404f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:18.535726 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-15957f52-acd3-42bf-87da-7153a032404f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:18.537304 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-15957f52-acd3-42bf-87da-7153a032404f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:18.538957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-15957f52-acd3-42bf-87da-7153a032404f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1406 microversion: 2.20 time: 0.220856 Jul 12 17:33:18.548676 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 383/788] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:33:18 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:33:19.046622 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e27bf63f-0d0b-4946-86b8-d7711205d429 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:19.047227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e27bf63f-0d0b-4946-86b8-d7711205d429 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] [instance: f4d99e1a-efd3-4510-ac75-1c21c7937044] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:19.053854 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e27bf63f-0d0b-4946-86b8-d7711205d429 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:19.054302 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e27bf63f-0d0b-4946-86b8-d7711205d429 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:19.055063 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e27bf63f-0d0b-4946-86b8-d7711205d429 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:19.055491 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e27bf63f-0d0b-4946-86b8-d7711205d429 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:19.069041 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-e27bf63f-0d0b-4946-86b8-d7711205d429 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] HTTP exception thrown: Instance f4d99e1a-efd3-4510-ac75-1c21c7937044 could not be found. Jul 12 17:33:19.070711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e27bf63f-0d0b-4946-86b8-d7711205d429 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Request method failure captured: Jul 12 17:33:19.070711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 HTTP/1.1 Jul 12 17:33:19.070711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:33:19.070711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:33:19.070711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:33:19.070711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:33:19.070711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:33:19.070711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:33:19.070711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:33:19.070711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:33:19.070711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza6rtSgQfpSEtZ33IwhEqpKxmMGz09pu5YbdTNTT6Fheask6iWh4UHUt4FI8V1LgyIrpYykgBodOOWWf2Mu8K7Zj7tYnj7ZacrJDVDubl2Llq3NDzasM5K4t3A3ipyRv-AeEDGWJXxr1RuzCzLapbei7evPQzraouwzSNqwP_LaByJ8 Jul 12 17:33:19.070711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:33:19.070711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:33:19.070711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:33:19.070711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:33:19.070711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:33:19.070711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:33:19.070711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: 13884af024db42bcb013e475df0a53f0 Jul 12 17:33:19.070711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-425710136 Jul 12 17:33:19.070711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:33:19.070711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:33:19.072225 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/13884af024db42bcb013e475df0a53f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/13884af024db42bcb013e475df0a53f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/13884af024db42bcb013e475df0a53f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_13884af024db42bcb013e475df0a53f0", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:33:19.072225 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-ServerRescueNegativeTestJSON-425710136 Jul 12 17:33:19.072225 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 13884af024db42bcb013e475df0a53f0 Jul 12 17:33:19.072225 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-425710136 Jul 12 17:33:19.072225 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-ServerRescueNegativeTestJSON-425710136-project Jul 12 17:33:19.072225 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:33:19.072225 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:33:19.072225 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: 35e0364ccc1d4992932e8483e3f1f9d6 Jul 12 17:33:19.072225 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-ServerRescueNegativeTestJSON-425710136-project Jul 12 17:33:19.072225 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:33:19.072225 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Instance f4d99e1a-efd3-4510-ac75-1c21c7937044 could not be found. Jul 12 17:33:19.072225 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': 'f4d99e1a-efd3-4510-ac75-1c21c7937044'} Jul 12 17:33:19.073094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:33:19.073094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:33:19.073094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:33:19.073094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:33:19.073094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:33:19.073094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:33:19.073094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:33:19.073094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:33:19.073094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:33:19.073094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:33:19.073094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4d99e1a-efd3-4510-ac75-1c21c7937044 could not be found. Jul 12 17:33:19.073094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:33:19.073094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:33:19.073094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:33:19.073094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:33:19.073094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:33:19.073094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:33:19.073094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:33:19.073094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:33:19.073094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:33:19.074986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:33:19.074986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:33:19.074986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:33:19.074986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:33:19.074986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:33:19.074986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:33:19.074986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:33:19.074986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4d99e1a-efd3-4510-ac75-1c21c7937044 could not be found. Jul 12 17:33:19.074986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:33:19.074986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:33:19.074986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:33:19.074986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:33:19.074986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:33:19.074986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:33:19.074986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:33:19.074986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:33:19.074986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4d99e1a-efd3-4510-ac75-1c21c7937044 could not be found. Jul 12 17:33:19.074986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:33:19.076483 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e27bf63f-0d0b-4946-86b8-d7711205d429 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] Returning 404 to user: Instance f4d99e1a-efd3-4510-ac75-1c21c7937044 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:33:19.076483 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e27bf63f-0d0b-4946-86b8-d7711205d429 tempest-ServerRescueNegativeTestJSON-425710136 tempest-ServerRescueNegativeTestJSON-425710136-project] 10.222.0.62 "GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044" status: 404 len: 111 microversion: 2.1 time: 0.029368 Jul 12 17:33:19.076483 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 406/789] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:19 2022] GET /compute/v2.1/servers/f4d99e1a-efd3-4510-ac75-1c21c7937044 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:33:19.237626 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-69857f33-90bc-495f-ae1f-2ff39473c962 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:19.238261 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-69857f33-90bc-495f-ae1f-2ff39473c962 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:19.244953 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-69857f33-90bc-495f-ae1f-2ff39473c962 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:19.245398 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-69857f33-90bc-495f-ae1f-2ff39473c962 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:19.246195 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-69857f33-90bc-495f-ae1f-2ff39473c962 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:19.246626 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-69857f33-90bc-495f-ae1f-2ff39473c962 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:19.556211 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c7551a89-d8ce-4b2a-8348-e19bedd35aa6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:19.556970 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c7551a89-d8ce-4b2a-8348-e19bedd35aa6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:19.563031 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c7551a89-d8ce-4b2a-8348-e19bedd35aa6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:19.563572 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c7551a89-d8ce-4b2a-8348-e19bedd35aa6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:19.564404 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c7551a89-d8ce-4b2a-8348-e19bedd35aa6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:19.565429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c7551a89-d8ce-4b2a-8348-e19bedd35aa6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:19.669782 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-69857f33-90bc-495f-ae1f-2ff39473c962 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:19.677122 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-69857f33-90bc-495f-ae1f-2ff39473c962 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1259 microversion: 2.1 time: 0.443396 Jul 12 17:33:19.677709 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 384/790] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:19 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1259 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:19.684559 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=4 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:19.808659 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c7551a89-d8ce-4b2a-8348-e19bedd35aa6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:19.817019 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c7551a89-d8ce-4b2a-8348-e19bedd35aa6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:19.818795 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c7551a89-d8ce-4b2a-8348-e19bedd35aa6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:19.819895 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c7551a89-d8ce-4b2a-8348-e19bedd35aa6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1406 microversion: 2.20 time: 0.267693 Jul 12 17:33:19.820444 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 407/791] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:33:19 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:33:20.597705 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-40c2f411-78c9-47e9-a622-9a669f04922a req-ef0bb5f9-9f4e-4c35-a2f5-3845c0f80237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeedc087-222c-4452-bf37-2f152ce787a6", "name": "network-vif-plugged", "status": "completed", "tag": "c8a34f14-81f6-401c-83f7-ce051f443de8"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:33:20.606424 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-40c2f411-78c9-47e9-a622-9a669f04922a req-ef0bb5f9-9f4e-4c35-a2f5-3845c0f80237 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:20.606974 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-40c2f411-78c9-47e9-a622-9a669f04922a req-ef0bb5f9-9f4e-4c35-a2f5-3845c0f80237 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:20.618789 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-40c2f411-78c9-47e9-a622-9a669f04922a req-ef0bb5f9-9f4e-4c35-a2f5-3845c0f80237 service nova] Creating event network-vif-plugged:c8a34f14-81f6-401c-83f7-ce051f443de8 for instance aeedc087-222c-4452-bf37-2f152ce787a6 on hv-cinder-84932 Jul 12 17:33:20.623855 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-40c2f411-78c9-47e9-a622-9a669f04922a req-ef0bb5f9-9f4e-4c35-a2f5-3845c0f80237 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030248 Jul 12 17:33:20.624993 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 385/792] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:33:20.694495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-431982e8-e0a8-40e4-aab6-4859d1b0886b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:20.695201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-431982e8-e0a8-40e4-aab6-4859d1b0886b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:20.697271 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=18 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:20.702939 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-431982e8-e0a8-40e4-aab6-4859d1b0886b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:20.703484 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-431982e8-e0a8-40e4-aab6-4859d1b0886b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:20.704319 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-431982e8-e0a8-40e4-aab6-4859d1b0886b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:20.704823 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-431982e8-e0a8-40e4-aab6-4859d1b0886b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:20.837806 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3b9ef410-08e2-4099-a443-fd9db4461660 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:20.838506 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3b9ef410-08e2-4099-a443-fd9db4461660 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:20.844626 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3b9ef410-08e2-4099-a443-fd9db4461660 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:20.845074 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3b9ef410-08e2-4099-a443-fd9db4461660 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:20.846548 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3b9ef410-08e2-4099-a443-fd9db4461660 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:20.846993 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3b9ef410-08e2-4099-a443-fd9db4461660 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:20.944385 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-431982e8-e0a8-40e4-aab6-4859d1b0886b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:20.951734 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-431982e8-e0a8-40e4-aab6-4859d1b0886b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1259 microversion: 2.1 time: 0.262054 Jul 12 17:33:20.961555 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 408/793] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:20 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1259 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:21.043682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3b9ef410-08e2-4099-a443-fd9db4461660 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:21.051871 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3b9ef410-08e2-4099-a443-fd9db4461660 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:21.053391 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-3b9ef410-08e2-4099-a443-fd9db4461660 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:21.054565 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3b9ef410-08e2-4099-a443-fd9db4461660 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1406 microversion: 2.20 time: 0.221022 Jul 12 17:33:21.055309 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 386/794] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:33:20 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:33:21.968380 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-208ef302-3498-4099-b289-a137c157446e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:21.968996 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-208ef302-3498-4099-b289-a137c157446e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:21.975781 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-208ef302-3498-4099-b289-a137c157446e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:21.976424 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-208ef302-3498-4099-b289-a137c157446e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:21.977207 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-208ef302-3498-4099-b289-a137c157446e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:21.977650 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-208ef302-3498-4099-b289-a137c157446e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:22.074031 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4f0cd209-25cd-42a8-9c7a-ddd50e0f063e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:22.076275 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4f0cd209-25cd-42a8-9c7a-ddd50e0f063e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:22.084141 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4f0cd209-25cd-42a8-9c7a-ddd50e0f063e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:22.084759 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4f0cd209-25cd-42a8-9c7a-ddd50e0f063e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:22.086198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4f0cd209-25cd-42a8-9c7a-ddd50e0f063e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:22.086652 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4f0cd209-25cd-42a8-9c7a-ddd50e0f063e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:22.171037 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-208ef302-3498-4099-b289-a137c157446e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:22.180359 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-208ef302-3498-4099-b289-a137c157446e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1259 microversion: 2.1 time: 0.215775 Jul 12 17:33:22.180945 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 409/795] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:21 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:22.248751 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4f0cd209-25cd-42a8-9c7a-ddd50e0f063e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:22.257269 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4f0cd209-25cd-42a8-9c7a-ddd50e0f063e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:22.258798 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4f0cd209-25cd-42a8-9c7a-ddd50e0f063e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:22.259891 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4f0cd209-25cd-42a8-9c7a-ddd50e0f063e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1406 microversion: 2.20 time: 0.190869 Jul 12 17:33:22.260442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 387/796] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:33:22 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:33:23.197104 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b9ca3e68-1cb4-4b2b-8b36-c12ca6b62b2b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:23.197813 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b9ca3e68-1cb4-4b2b-8b36-c12ca6b62b2b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:23.207295 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9ca3e68-1cb4-4b2b-8b36-c12ca6b62b2b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:23.207750 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9ca3e68-1cb4-4b2b-8b36-c12ca6b62b2b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:23.208522 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9ca3e68-1cb4-4b2b-8b36-c12ca6b62b2b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:23.208952 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9ca3e68-1cb4-4b2b-8b36-c12ca6b62b2b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:23.278739 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-bdfe8bd4-9783-434a-8cf6-9aa9f66d521e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:23.279919 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-bdfe8bd4-9783-434a-8cf6-9aa9f66d521e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:23.289177 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bdfe8bd4-9783-434a-8cf6-9aa9f66d521e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:23.289988 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bdfe8bd4-9783-434a-8cf6-9aa9f66d521e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:23.291023 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bdfe8bd4-9783-434a-8cf6-9aa9f66d521e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:23.291657 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bdfe8bd4-9783-434a-8cf6-9aa9f66d521e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:23.410547 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b9ca3e68-1cb4-4b2b-8b36-c12ca6b62b2b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:23.414169 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:23.419533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b9ca3e68-1cb4-4b2b-8b36-c12ca6b62b2b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1259 microversion: 2.1 time: 0.226758 Jul 12 17:33:23.420308 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 410/797] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:23 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:23.458649 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-bdfe8bd4-9783-434a-8cf6-9aa9f66d521e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:23.466658 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-bdfe8bd4-9783-434a-8cf6-9aa9f66d521e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:23.468250 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-bdfe8bd4-9783-434a-8cf6-9aa9f66d521e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:23.469407 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-bdfe8bd4-9783-434a-8cf6-9aa9f66d521e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1599 microversion: 2.20 time: 0.195086 Jul 12 17:33:23.470342 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 388/798] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:33:23 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1599 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:33:23.488033 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1f64d001-a4d7-4f2b-94aa-cc0893896c2e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:23.488617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1f64d001-a4d7-4f2b-94aa-cc0893896c2e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:23.494919 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1f64d001-a4d7-4f2b-94aa-cc0893896c2e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:23.495434 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1f64d001-a4d7-4f2b-94aa-cc0893896c2e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:23.496224 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1f64d001-a4d7-4f2b-94aa-cc0893896c2e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:23.496653 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1f64d001-a4d7-4f2b-94aa-cc0893896c2e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:23.574290 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1f64d001-a4d7-4f2b-94aa-cc0893896c2e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090939 Jul 12 17:33:23.574880 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 411/799] 10.222.0.62 () {60 vars in 1315 bytes} [Tue Jul 12 17:33:23 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:33:24.436222 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c7d895f8-fbce-4ed0-92ba-8a6c5ae6a48f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:24.437035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c7d895f8-fbce-4ed0-92ba-8a6c5ae6a48f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:24.446262 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c7d895f8-fbce-4ed0-92ba-8a6c5ae6a48f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:24.447271 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c7d895f8-fbce-4ed0-92ba-8a6c5ae6a48f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:24.448215 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c7d895f8-fbce-4ed0-92ba-8a6c5ae6a48f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:24.448833 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c7d895f8-fbce-4ed0-92ba-8a6c5ae6a48f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:24.652951 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-7db2cd66-753f-4733-9239-a6a7a0d3f35f req-d8bf655e-bc9d-4636-b079-9b32d9f4754f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdfd07ca-55f6-48b2-b2c7-f202196e05ed", "name": "network-vif-plugged", "status": "completed", "tag": "78ee797f-f3e0-4e02-ba3d-1c9755d72b65"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:33:24.669448 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-7db2cd66-753f-4733-9239-a6a7a0d3f35f req-d8bf655e-bc9d-4636-b079-9b32d9f4754f service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:24.670218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-7db2cd66-753f-4733-9239-a6a7a0d3f35f req-d8bf655e-bc9d-4636-b079-9b32d9f4754f service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:24.685341 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-7db2cd66-753f-4733-9239-a6a7a0d3f35f req-d8bf655e-bc9d-4636-b079-9b32d9f4754f service nova] Creating event network-vif-plugged:78ee797f-f3e0-4e02-ba3d-1c9755d72b65 for instance bdfd07ca-55f6-48b2-b2c7-f202196e05ed on hv-cinder-84932 Jul 12 17:33:24.690941 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-7db2cd66-753f-4733-9239-a6a7a0d3f35f req-d8bf655e-bc9d-4636-b079-9b32d9f4754f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041702 Jul 12 17:33:24.692374 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 412/800] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:33:24.727309 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c7d895f8-fbce-4ed0-92ba-8a6c5ae6a48f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:24.747343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c7d895f8-fbce-4ed0-92ba-8a6c5ae6a48f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1259 microversion: 2.1 time: 0.313673 Jul 12 17:33:24.748641 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 389/801] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:24 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1259 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:24.903031 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-ea9a2739-31d6-414f-be67-69aa1af9348b req-d2d60c6b-369a-4a83-827c-6bb2286ef0b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeedc087-222c-4452-bf37-2f152ce787a6", "tag": "c8a34f14-81f6-401c-83f7-ce051f443de8"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:33:24.917604 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-ea9a2739-31d6-414f-be67-69aa1af9348b req-d2d60c6b-369a-4a83-827c-6bb2286ef0b9 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:24.918641 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-ea9a2739-31d6-414f-be67-69aa1af9348b req-d2d60c6b-369a-4a83-827c-6bb2286ef0b9 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:24.932658 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-ea9a2739-31d6-414f-be67-69aa1af9348b req-d2d60c6b-369a-4a83-827c-6bb2286ef0b9 service nova] Creating event network-changed:c8a34f14-81f6-401c-83f7-ce051f443de8 for instance aeedc087-222c-4452-bf37-2f152ce787a6 on hv-cinder-84932 Jul 12 17:33:24.940651 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-ea9a2739-31d6-414f-be67-69aa1af9348b req-d2d60c6b-369a-4a83-827c-6bb2286ef0b9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042634 Jul 12 17:33:24.941921 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 413/802] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:33:25.764332 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9fa44087-9f29-4408-b3a0-5fb0f4463ecf tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:25.765467 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9fa44087-9f29-4408-b3a0-5fb0f4463ecf tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:25.773159 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9fa44087-9f29-4408-b3a0-5fb0f4463ecf tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:25.773607 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9fa44087-9f29-4408-b3a0-5fb0f4463ecf tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:25.774459 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9fa44087-9f29-4408-b3a0-5fb0f4463ecf tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:25.774895 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9fa44087-9f29-4408-b3a0-5fb0f4463ecf tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:25.913237 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9fa44087-9f29-4408-b3a0-5fb0f4463ecf tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:25.921085 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9fa44087-9f29-4408-b3a0-5fb0f4463ecf tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1259 microversion: 2.1 time: 0.160539 Jul 12 17:33:25.922010 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 390/803] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:25 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:26.500121 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fd0ec8f7-0c0b-45e2-bbc3-843621ae7f69 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:26.500700 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fd0ec8f7-0c0b-45e2-bbc3-843621ae7f69 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:26.507731 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fd0ec8f7-0c0b-45e2-bbc3-843621ae7f69 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:26.508181 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fd0ec8f7-0c0b-45e2-bbc3-843621ae7f69 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:26.508979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fd0ec8f7-0c0b-45e2-bbc3-843621ae7f69 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:26.509413 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fd0ec8f7-0c0b-45e2-bbc3-843621ae7f69 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:26.533774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fd0ec8f7-0c0b-45e2-bbc3-843621ae7f69 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:33:26.606928 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fd0ec8f7-0c0b-45e2-bbc3-843621ae7f69 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "DELETE /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 204 len: 0 microversion: 2.1 time: 0.110552 Jul 12 17:33:26.607427 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 414/804] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:33:26 2022] DELETE /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:33:26.615345 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4c485022-51ef-4e34-a32e-9a8dd5f41704 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:26.615960 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4c485022-51ef-4e34-a32e-9a8dd5f41704 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:26.621891 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4c485022-51ef-4e34-a32e-9a8dd5f41704 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:26.622343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4c485022-51ef-4e34-a32e-9a8dd5f41704 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:26.623140 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4c485022-51ef-4e34-a32e-9a8dd5f41704 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:26.623576 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4c485022-51ef-4e34-a32e-9a8dd5f41704 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:26.763304 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4c485022-51ef-4e34-a32e-9a8dd5f41704 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:26.771395 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4c485022-51ef-4e34-a32e-9a8dd5f41704 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1577 microversion: 2.1 time: 0.159830 Jul 12 17:33:26.771967 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 391/805] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:26 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:26.938612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-058b2c2c-d2ba-4515-9781-dd98aa2fd2fb tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:26.939311 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-058b2c2c-d2ba-4515-9781-dd98aa2fd2fb tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:26.946147 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-058b2c2c-d2ba-4515-9781-dd98aa2fd2fb tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:26.946596 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-058b2c2c-d2ba-4515-9781-dd98aa2fd2fb tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:26.947352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-058b2c2c-d2ba-4515-9781-dd98aa2fd2fb tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:26.947787 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-058b2c2c-d2ba-4515-9781-dd98aa2fd2fb tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:27.083465 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-058b2c2c-d2ba-4515-9781-dd98aa2fd2fb tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:27.090957 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-058b2c2c-d2ba-4515-9781-dd98aa2fd2fb tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1442 microversion: 2.1 time: 0.156557 Jul 12 17:33:27.091537 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 415/806] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:26 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1442 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:27.107325 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-13d46022-1d78-4a70-8f85-f9ea8e09d76b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:27.107927 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-13d46022-1d78-4a70-8f85-f9ea8e09d76b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:27.114845 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-13d46022-1d78-4a70-8f85-f9ea8e09d76b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:27.115290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-13d46022-1d78-4a70-8f85-f9ea8e09d76b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:27.116074 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-13d46022-1d78-4a70-8f85-f9ea8e09d76b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:27.116505 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-13d46022-1d78-4a70-8f85-f9ea8e09d76b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:27.242968 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-13d46022-1d78-4a70-8f85-f9ea8e09d76b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:27.250236 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-13d46022-1d78-4a70-8f85-f9ea8e09d76b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1442 microversion: 2.1 time: 0.146702 Jul 12 17:33:27.250802 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 392/807] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:27 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1442 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:27.789347 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c8f622fc-e87c-4e1a-b1cf-cae18f1d5652 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:27.789991 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c8f622fc-e87c-4e1a-b1cf-cae18f1d5652 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:27.795959 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c8f622fc-e87c-4e1a-b1cf-cae18f1d5652 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:27.796405 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c8f622fc-e87c-4e1a-b1cf-cae18f1d5652 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:27.797173 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c8f622fc-e87c-4e1a-b1cf-cae18f1d5652 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:27.797608 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c8f622fc-e87c-4e1a-b1cf-cae18f1d5652 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:28.015156 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c8f622fc-e87c-4e1a-b1cf-cae18f1d5652 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:28.023425 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c8f622fc-e87c-4e1a-b1cf-cae18f1d5652 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1577 microversion: 2.1 time: 0.237828 Jul 12 17:33:28.023933 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 416/808] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:27 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1577 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:29.040415 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5ea271c8-d779-41c3-bdae-71c29d2c5d8c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:29.041207 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5ea271c8-d779-41c3-bdae-71c29d2c5d8c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:29.048164 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5ea271c8-d779-41c3-bdae-71c29d2c5d8c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:29.048807 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5ea271c8-d779-41c3-bdae-71c29d2c5d8c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:29.049678 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5ea271c8-d779-41c3-bdae-71c29d2c5d8c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:29.050233 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5ea271c8-d779-41c3-bdae-71c29d2c5d8c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:29.065054 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-f8c3c794-3ce2-4dac-8263-363ec78c2c2d req-62501462-556c-45d1-97ce-bfd687638895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdfd07ca-55f6-48b2-b2c7-f202196e05ed", "tag": "78ee797f-f3e0-4e02-ba3d-1c9755d72b65"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:33:29.073863 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-f8c3c794-3ce2-4dac-8263-363ec78c2c2d req-62501462-556c-45d1-97ce-bfd687638895 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:29.074551 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-f8c3c794-3ce2-4dac-8263-363ec78c2c2d req-62501462-556c-45d1-97ce-bfd687638895 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:29.086429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-f8c3c794-3ce2-4dac-8263-363ec78c2c2d req-62501462-556c-45d1-97ce-bfd687638895 service nova] Creating event network-changed:78ee797f-f3e0-4e02-ba3d-1c9755d72b65 for instance bdfd07ca-55f6-48b2-b2c7-f202196e05ed on hv-cinder-84932 Jul 12 17:33:29.091665 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-f8c3c794-3ce2-4dac-8263-363ec78c2c2d req-62501462-556c-45d1-97ce-bfd687638895 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030467 Jul 12 17:33:29.092513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 417/809] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:33:29.188636 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5ea271c8-d779-41c3-bdae-71c29d2c5d8c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:29.196388 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5ea271c8-d779-41c3-bdae-71c29d2c5d8c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1577 microversion: 2.1 time: 0.159811 Jul 12 17:33:29.196950 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 393/810] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:29 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:30.214717 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7b90902e-738f-4321-b0d0-c3a82e1b60c6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:30.215407 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7b90902e-738f-4321-b0d0-c3a82e1b60c6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:30.222100 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7b90902e-738f-4321-b0d0-c3a82e1b60c6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:30.222535 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7b90902e-738f-4321-b0d0-c3a82e1b60c6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:30.223278 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7b90902e-738f-4321-b0d0-c3a82e1b60c6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:30.223705 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7b90902e-738f-4321-b0d0-c3a82e1b60c6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:30.353937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7b90902e-738f-4321-b0d0-c3a82e1b60c6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:30.362694 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7b90902e-738f-4321-b0d0-c3a82e1b60c6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1577 microversion: 2.1 time: 0.152225 Jul 12 17:33:30.363267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 418/811] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:30 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:31.379504 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-57b2bc0e-6153-4678-a127-02e00d076f43 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:31.380739 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-57b2bc0e-6153-4678-a127-02e00d076f43 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:31.387328 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-57b2bc0e-6153-4678-a127-02e00d076f43 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:31.387778 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-57b2bc0e-6153-4678-a127-02e00d076f43 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:31.388547 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-57b2bc0e-6153-4678-a127-02e00d076f43 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:31.388984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-57b2bc0e-6153-4678-a127-02e00d076f43 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:31.519430 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-57b2bc0e-6153-4678-a127-02e00d076f43 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:31.526831 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-57b2bc0e-6153-4678-a127-02e00d076f43 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1577 microversion: 2.1 time: 0.151189 Jul 12 17:33:31.527553 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 394/812] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:31 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:32.544231 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-925ccc22-c3ea-48c0-b1e6-e7d02f199929 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:32.544844 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-925ccc22-c3ea-48c0-b1e6-e7d02f199929 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:32.551447 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-925ccc22-c3ea-48c0-b1e6-e7d02f199929 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:32.551888 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-925ccc22-c3ea-48c0-b1e6-e7d02f199929 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:32.552634 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-925ccc22-c3ea-48c0-b1e6-e7d02f199929 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:32.553063 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-925ccc22-c3ea-48c0-b1e6-e7d02f199929 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:32.682921 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-925ccc22-c3ea-48c0-b1e6-e7d02f199929 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:32.690245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-925ccc22-c3ea-48c0-b1e6-e7d02f199929 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1577 microversion: 2.1 time: 0.149890 Jul 12 17:33:32.690801 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 419/813] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:32 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:33.707225 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-93b03e6b-44b8-491d-a206-6b0a8c8969ce tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:33.707838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-93b03e6b-44b8-491d-a206-6b0a8c8969ce tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:33.713943 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-93b03e6b-44b8-491d-a206-6b0a8c8969ce tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:33.714388 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-93b03e6b-44b8-491d-a206-6b0a8c8969ce tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:33.715178 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-93b03e6b-44b8-491d-a206-6b0a8c8969ce tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:33.715607 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-93b03e6b-44b8-491d-a206-6b0a8c8969ce tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:33.841769 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-93b03e6b-44b8-491d-a206-6b0a8c8969ce tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:33.849681 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-93b03e6b-44b8-491d-a206-6b0a8c8969ce tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1577 microversion: 2.1 time: 0.146307 Jul 12 17:33:33.850265 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 395/814] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:33 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1577 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:34.866282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-04a8bdd0-af29-4087-923c-cdc822281f26 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:34.866892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-04a8bdd0-af29-4087-923c-cdc822281f26 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:34.873098 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-04a8bdd0-af29-4087-923c-cdc822281f26 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:34.873553 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-04a8bdd0-af29-4087-923c-cdc822281f26 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:34.874357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-04a8bdd0-af29-4087-923c-cdc822281f26 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:34.874789 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-04a8bdd0-af29-4087-923c-cdc822281f26 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:35.004770 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-04a8bdd0-af29-4087-923c-cdc822281f26 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:35.012622 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-04a8bdd0-af29-4087-923c-cdc822281f26 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1577 microversion: 2.1 time: 0.150140 Jul 12 17:33:35.013193 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 420/815] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:34 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:36.029365 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c8f7def1-7112-4ddd-82f6-2d4b22b545c5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:36.030029 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c8f7def1-7112-4ddd-82f6-2d4b22b545c5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:36.037185 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c8f7def1-7112-4ddd-82f6-2d4b22b545c5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:36.037640 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c8f7def1-7112-4ddd-82f6-2d4b22b545c5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:36.038489 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c8f7def1-7112-4ddd-82f6-2d4b22b545c5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:36.038935 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c8f7def1-7112-4ddd-82f6-2d4b22b545c5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:36.226470 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c8f7def1-7112-4ddd-82f6-2d4b22b545c5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:36.233962 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c8f7def1-7112-4ddd-82f6-2d4b22b545c5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1577 microversion: 2.1 time: 0.208493 Jul 12 17:33:36.234533 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 396/816] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:36 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1577 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:37.250771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-675682ec-fa52-4635-9d1a-25421ae1610e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:37.251408 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-675682ec-fa52-4635-9d1a-25421ae1610e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:37.258069 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-675682ec-fa52-4635-9d1a-25421ae1610e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:37.258509 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-675682ec-fa52-4635-9d1a-25421ae1610e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:37.259259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-675682ec-fa52-4635-9d1a-25421ae1610e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:37.259687 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-675682ec-fa52-4635-9d1a-25421ae1610e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:37.790080 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-675682ec-fa52-4635-9d1a-25421ae1610e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:37.798062 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-675682ec-fa52-4635-9d1a-25421ae1610e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1577 microversion: 2.1 time: 0.551125 Jul 12 17:33:37.798628 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 421/817] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:37 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1577 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:38.498509 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-487c4e74-6b28-4e6a-ac58-57301c428f47 req-74739292-244e-424f-a325-d7503913cb01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a152ab-692f-42e7-9c24-a69291f449ae", "name": "network-vif-deleted", "tag": "3805d085-cefa-43b1-a617-e660f2c6e92e"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:33:38.507991 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-487c4e74-6b28-4e6a-ac58-57301c428f47 req-74739292-244e-424f-a325-d7503913cb01 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:38.508435 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-487c4e74-6b28-4e6a-ac58-57301c428f47 req-74739292-244e-424f-a325-d7503913cb01 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:38.523282 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-487c4e74-6b28-4e6a-ac58-57301c428f47 req-74739292-244e-424f-a325-d7503913cb01 service nova] Creating event network-vif-deleted:3805d085-cefa-43b1-a617-e660f2c6e92e for instance 75a152ab-692f-42e7-9c24-a69291f449ae on hv-cinder-84932 Jul 12 17:33:38.529123 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-487c4e74-6b28-4e6a-ac58-57301c428f47 req-74739292-244e-424f-a325-d7503913cb01 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034383 Jul 12 17:33:38.529837 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 397/818] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:33:38.815139 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ee953c9f-718d-4b2c-ae43-48d2e7833b78 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:38.815868 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ee953c9f-718d-4b2c-ae43-48d2e7833b78 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:38.822076 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ee953c9f-718d-4b2c-ae43-48d2e7833b78 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:38.822523 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ee953c9f-718d-4b2c-ae43-48d2e7833b78 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:38.823271 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ee953c9f-718d-4b2c-ae43-48d2e7833b78 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:38.823701 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ee953c9f-718d-4b2c-ae43-48d2e7833b78 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:38.886520 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ee953c9f-718d-4b2c-ae43-48d2e7833b78 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:38.894698 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ee953c9f-718d-4b2c-ae43-48d2e7833b78 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1226 microversion: 2.1 time: 0.083331 Jul 12 17:33:38.895612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 422/819] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:38 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:39.913478 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-bacb6007-1377-4b04-82d2-53022c3d14d5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:39.914196 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-bacb6007-1377-4b04-82d2-53022c3d14d5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:39.920354 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bacb6007-1377-4b04-82d2-53022c3d14d5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:39.920828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bacb6007-1377-4b04-82d2-53022c3d14d5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:39.921585 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bacb6007-1377-4b04-82d2-53022c3d14d5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:39.922046 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bacb6007-1377-4b04-82d2-53022c3d14d5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:39.985870 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-bacb6007-1377-4b04-82d2-53022c3d14d5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:39.993879 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-bacb6007-1377-4b04-82d2-53022c3d14d5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1226 microversion: 2.1 time: 0.085497 Jul 12 17:33:39.994437 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 398/820] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:39 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:41.010088 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-151bcb68-0439-47c5-ab21-daf4cd41c400 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:41.010707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-151bcb68-0439-47c5-ab21-daf4cd41c400 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:41.016629 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-151bcb68-0439-47c5-ab21-daf4cd41c400 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:41.017122 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-151bcb68-0439-47c5-ab21-daf4cd41c400 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:41.017928 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-151bcb68-0439-47c5-ab21-daf4cd41c400 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:41.018770 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-151bcb68-0439-47c5-ab21-daf4cd41c400 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:41.077657 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-151bcb68-0439-47c5-ab21-daf4cd41c400 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:41.085450 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-151bcb68-0439-47c5-ab21-daf4cd41c400 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1226 microversion: 2.1 time: 0.079232 Jul 12 17:33:41.086045 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 423/821] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:41 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:42.102618 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b710e848-b65b-45af-9184-841f60bf6745 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:42.103232 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b710e848-b65b-45af-9184-841f60bf6745 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:42.109617 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b710e848-b65b-45af-9184-841f60bf6745 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:42.110091 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b710e848-b65b-45af-9184-841f60bf6745 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:42.110853 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b710e848-b65b-45af-9184-841f60bf6745 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:42.111299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b710e848-b65b-45af-9184-841f60bf6745 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:42.129175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:42.171833 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b710e848-b65b-45af-9184-841f60bf6745 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:42.179867 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b710e848-b65b-45af-9184-841f60bf6745 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1226 microversion: 2.1 time: 0.081132 Jul 12 17:33:42.180423 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 399/822] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:42 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:43.197194 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5c5e55ee-c5dd-42af-8ac8-a1af4d1dcf05 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:43.197838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5c5e55ee-c5dd-42af-8ac8-a1af4d1dcf05 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:43.199818 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:43.206419 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5c5e55ee-c5dd-42af-8ac8-a1af4d1dcf05 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:43.206892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5c5e55ee-c5dd-42af-8ac8-a1af4d1dcf05 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:43.207649 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5c5e55ee-c5dd-42af-8ac8-a1af4d1dcf05 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:43.208081 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5c5e55ee-c5dd-42af-8ac8-a1af4d1dcf05 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:43.269097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5c5e55ee-c5dd-42af-8ac8-a1af4d1dcf05 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:43.276528 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5c5e55ee-c5dd-42af-8ac8-a1af4d1dcf05 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1226 microversion: 2.1 time: 0.083223 Jul 12 17:33:43.277092 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 424/823] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:43 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:44.293618 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0c5f021c-0354-4432-88b3-a208a4f44c58 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:44.294407 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0c5f021c-0354-4432-88b3-a208a4f44c58 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:44.301780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0c5f021c-0354-4432-88b3-a208a4f44c58 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:44.302236 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0c5f021c-0354-4432-88b3-a208a4f44c58 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:44.303038 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0c5f021c-0354-4432-88b3-a208a4f44c58 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:44.303483 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0c5f021c-0354-4432-88b3-a208a4f44c58 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:44.342555 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0c5f021c-0354-4432-88b3-a208a4f44c58 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:44.343231 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0c5f021c-0354-4432-88b3-a208a4f44c58 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:44.343721 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-0c5f021c-0354-4432-88b3-a208a4f44c58 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lazy-loading 'fault' on Instance uuid 75a152ab-692f-42e7-9c24-a69291f449ae {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:33:44.387210 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0c5f021c-0354-4432-88b3-a208a4f44c58 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:44.394443 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0c5f021c-0354-4432-88b3-a208a4f44c58 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 200 len: 1185 microversion: 2.1 time: 0.104968 Jul 12 17:33:44.395008 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 400/824] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:44 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 1185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:45.411780 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-00eec050-1eab-4f0b-a5e9-a725128e6475 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:45.412395 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-00eec050-1eab-4f0b-a5e9-a725128e6475 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:45.418398 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00eec050-1eab-4f0b-a5e9-a725128e6475 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:45.418848 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00eec050-1eab-4f0b-a5e9-a725128e6475 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:45.419611 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00eec050-1eab-4f0b-a5e9-a725128e6475 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:45.420050 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00eec050-1eab-4f0b-a5e9-a725128e6475 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:45.433003 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-00eec050-1eab-4f0b-a5e9-a725128e6475 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] HTTP exception thrown: Instance 75a152ab-692f-42e7-9c24-a69291f449ae could not be found. Jul 12 17:33:45.434639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-00eec050-1eab-4f0b-a5e9-a725128e6475 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Request method failure captured: Jul 12 17:33:45.434639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae HTTP/1.1 Jul 12 17:33:45.434639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:33:45.434639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:33:45.434639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:33:45.434639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:33:45.434639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:33:45.434639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:33:45.434639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:33:45.434639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:33:45.434639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza-TAjWcHaOSpqkySXwtb2WNZD2BFD3qEUKFTEDhpJWu4v5zBpIvQd0dbUHnTgGxpYcI8fsjfzYhzMBG3txmDl3KHYEAVBooKP4TzbKv8urkgfMv4Ld9fgYL3eylu_bzQrt0j1ojfL_66HTGtsm7pvbc14q-abmsGJC-Cf3FAaJ8dfw Jul 12 17:33:45.434639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:33:45.434639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:33:45.434639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:33:45.434639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:33:45.434639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:33:45.434639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:33:45.434639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: 471e1e958b29427eb024616ca403985f Jul 12 17:33:45.434639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-TestVolumeBootPattern-1374833581 Jul 12 17:33:45.434639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:33:45.434639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:33:45.436294 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/471e1e958b29427eb024616ca403985f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/471e1e958b29427eb024616ca403985f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/471e1e958b29427eb024616ca403985f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_471e1e958b29427eb024616ca403985f", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:33:45.436294 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-TestVolumeBootPattern-1374833581 Jul 12 17:33:45.436294 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 471e1e958b29427eb024616ca403985f Jul 12 17:33:45.436294 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-TestVolumeBootPattern-1374833581 Jul 12 17:33:45.436294 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-TestVolumeBootPattern-1374833581-project Jul 12 17:33:45.436294 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:33:45.436294 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:33:45.436294 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: 4e066a1d960f48d2ad78d13fc723f54e Jul 12 17:33:45.436294 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-TestVolumeBootPattern-1374833581-project Jul 12 17:33:45.436294 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:33:45.436294 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Instance 75a152ab-692f-42e7-9c24-a69291f449ae could not be found. Jul 12 17:33:45.436294 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': '75a152ab-692f-42e7-9c24-a69291f449ae'} Jul 12 17:33:45.437259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:33:45.437259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:33:45.437259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:33:45.437259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:33:45.437259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:33:45.437259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:33:45.437259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:33:45.437259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:33:45.437259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:33:45.437259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:33:45.437259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a152ab-692f-42e7-9c24-a69291f449ae could not be found. Jul 12 17:33:45.437259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:33:45.437259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:33:45.437259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:33:45.437259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:33:45.437259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:33:45.437259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:33:45.437259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:33:45.437259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:33:45.437259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:33:45.438962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:33:45.438962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:33:45.438962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:33:45.438962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:33:45.438962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:33:45.438962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:33:45.438962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:33:45.438962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a152ab-692f-42e7-9c24-a69291f449ae could not be found. Jul 12 17:33:45.438962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:33:45.438962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:33:45.438962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:33:45.438962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:33:45.438962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:33:45.438962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:33:45.438962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:33:45.438962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:33:45.438962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a152ab-692f-42e7-9c24-a69291f449ae could not be found. Jul 12 17:33:45.438962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:33:45.440387 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-00eec050-1eab-4f0b-a5e9-a725128e6475 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Returning 404 to user: Instance 75a152ab-692f-42e7-9c24-a69291f449ae could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:33:45.440387 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-00eec050-1eab-4f0b-a5e9-a725128e6475 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 404 len: 111 microversion: 2.1 time: 0.028706 Jul 12 17:33:45.440387 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 425/825] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:45 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:33:45.527099 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c704f60d-aa7d-4627-a443-526b3866f0d0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1662730057", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1098037494", "security_groups": [{"name": "tempest-secgroup-smoke-538136482"}], "block_device_mapping_v2": [{"uuid": "0ebdbe5e-fa1a-40ea-ae3b-4bedbd4a43f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "669116b9-7a59-4591-9422-ba3889789c63"}]}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:33:45.635856 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.network.neutron [None req-c704f60d-aa7d-4627-a443-526b3866f0d0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] validate_networks() for [('669116b9-7a59-4591-9422-ba3889789c63', None, None, None, None, None)] {{(pid=117939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:33:46.032589 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-c704f60d-aa7d-4627-a443-526b3866f0d0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Flavor limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:33:46.033009 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-c704f60d-aa7d-4627-a443-526b3866f0d0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Image limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:33:46.033481 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-c704f60d-aa7d-4627-a443-526b3866f0d0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Flavor pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:33:46.033939 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-c704f60d-aa7d-4627-a443-526b3866f0d0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Image pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:33:46.034349 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-c704f60d-aa7d-4627-a443-526b3866f0d0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:33:46.042984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c704f60d-aa7d-4627-a443-526b3866f0d0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:46.043431 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c704f60d-aa7d-4627-a443-526b3866f0d0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:46.044279 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c704f60d-aa7d-4627-a443-526b3866f0d0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:46.044710 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c704f60d-aa7d-4627-a443-526b3866f0d0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:46.063543 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-c704f60d-aa7d-4627-a443-526b3866f0d0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Getting quotas for project 471e1e958b29427eb024616ca403985f. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:33:46.068330 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-c704f60d-aa7d-4627-a443-526b3866f0d0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Getting quotas for user 4e066a1d960f48d2ad78d13fc723f54e and project 471e1e958b29427eb024616ca403985f. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:33:46.127400 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c704f60d-aa7d-4627-a443-526b3866f0d0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Going to run 1 instances... {{(pid=117939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:33:46.130173 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c704f60d-aa7d-4627-a443-526b3866f0d0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ebdbe5e-fa1a-40ea-ae3b-4bedbd4a43f7',volume_size=None,volume_type=None)] {{(pid=117939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:33:46.255775 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c704f60d-aa7d-4627-a443-526b3866f0d0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.732337 Jul 12 17:33:46.256328 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 401/826] 10.222.0.62 () {60 vars in 1146 bytes} [Tue Jul 12 17:33:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:33:46.266464 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-98e9ccf5-3dea-4f20-8d06-ad75b97e370f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:46.267162 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-98e9ccf5-3dea-4f20-8d06-ad75b97e370f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:46.320449 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-98e9ccf5-3dea-4f20-8d06-ad75b97e370f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:46.327352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-98e9ccf5-3dea-4f20-8d06-ad75b97e370f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1095 microversion: 2.1 time: 0.064788 Jul 12 17:33:46.328265 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 426/827] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:46 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:47.345229 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f84ee33c-c0bb-4e95-94ca-71f8306ba091 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:47.345901 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f84ee33c-c0bb-4e95-94ca-71f8306ba091 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:47.352057 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f84ee33c-c0bb-4e95-94ca-71f8306ba091 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:47.352515 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f84ee33c-c0bb-4e95-94ca-71f8306ba091 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:47.353254 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f84ee33c-c0bb-4e95-94ca-71f8306ba091 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:47.353705 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f84ee33c-c0bb-4e95-94ca-71f8306ba091 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:47.412721 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f84ee33c-c0bb-4e95-94ca-71f8306ba091 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:47.419977 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f84ee33c-c0bb-4e95-94ca-71f8306ba091 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1145 microversion: 2.1 time: 0.079070 Jul 12 17:33:47.420531 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 402/828] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:47 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:48.436242 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-496dda51-8240-4627-8a09-949553c1bad5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:48.436849 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-496dda51-8240-4627-8a09-949553c1bad5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:48.443183 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-496dda51-8240-4627-8a09-949553c1bad5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:48.443622 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-496dda51-8240-4627-8a09-949553c1bad5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:48.444369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-496dda51-8240-4627-8a09-949553c1bad5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:48.444863 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-496dda51-8240-4627-8a09-949553c1bad5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:48.507423 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-496dda51-8240-4627-8a09-949553c1bad5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:48.515538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-496dda51-8240-4627-8a09-949553c1bad5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1145 microversion: 2.1 time: 0.083124 Jul 12 17:33:48.516095 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 427/829] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:48 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:49.532303 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-fbbf18ad-3849-4427-8b73-9376fca7cd02 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:49.532919 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-fbbf18ad-3849-4427-8b73-9376fca7cd02 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:49.535721 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:49.540954 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fbbf18ad-3849-4427-8b73-9376fca7cd02 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:49.541403 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fbbf18ad-3849-4427-8b73-9376fca7cd02 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:49.542203 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fbbf18ad-3849-4427-8b73-9376fca7cd02 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:49.542654 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fbbf18ad-3849-4427-8b73-9376fca7cd02 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:49.604888 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fbbf18ad-3849-4427-8b73-9376fca7cd02 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:49.612772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-fbbf18ad-3849-4427-8b73-9376fca7cd02 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1137 microversion: 2.1 time: 0.083682 Jul 12 17:33:49.613335 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 403/830] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:49 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:50.030561 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d0ca3497-6bbf-4d2f-8759-6199dca9066a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:50.031051 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d0ca3497-6bbf-4d2f-8759-6199dca9066a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:50.037443 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0ca3497-6bbf-4d2f-8759-6199dca9066a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:50.037929 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0ca3497-6bbf-4d2f-8759-6199dca9066a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:50.038721 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0ca3497-6bbf-4d2f-8759-6199dca9066a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:50.039146 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d0ca3497-6bbf-4d2f-8759-6199dca9066a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:50.060983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d0ca3497-6bbf-4d2f-8759-6199dca9066a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd/ips" status: 200 len: 150 microversion: 2.1 time: 0.034227 Jul 12 17:33:50.061532 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 428/831] 10.222.0.62 () {58 vars in 1247 bytes} [Tue Jul 12 17:33:50 2022] GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd/ips => generated 150 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:33:50.630834 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-99c4ee9f-420e-4cc7-81f3-11f53db47e4a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:50.631448 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-99c4ee9f-420e-4cc7-81f3-11f53db47e4a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:50.637921 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-99c4ee9f-420e-4cc7-81f3-11f53db47e4a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:50.638372 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-99c4ee9f-420e-4cc7-81f3-11f53db47e4a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:50.639155 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-99c4ee9f-420e-4cc7-81f3-11f53db47e4a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:50.639620 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-99c4ee9f-420e-4cc7-81f3-11f53db47e4a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:50.719517 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-99c4ee9f-420e-4cc7-81f3-11f53db47e4a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:50.727812 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-99c4ee9f-420e-4cc7-81f3-11f53db47e4a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1201 microversion: 2.1 time: 0.101837 Jul 12 17:33:50.728380 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 404/832] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:50 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1201 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:51.745639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7fcf3b1c-0c41-4886-baf6-a0a2d2460ae7 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:51.746302 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7fcf3b1c-0c41-4886-baf6-a0a2d2460ae7 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:51.757824 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7fcf3b1c-0c41-4886-baf6-a0a2d2460ae7 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:51.758278 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7fcf3b1c-0c41-4886-baf6-a0a2d2460ae7 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:51.759046 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7fcf3b1c-0c41-4886-baf6-a0a2d2460ae7 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:51.759480 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7fcf3b1c-0c41-4886-baf6-a0a2d2460ae7 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:51.994268 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7fcf3b1c-0c41-4886-baf6-a0a2d2460ae7 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:52.001669 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7fcf3b1c-0c41-4886-baf6-a0a2d2460ae7 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1278 microversion: 2.1 time: 0.260043 Jul 12 17:33:52.002257 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 429/833] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:51 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1278 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:52.363022 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-d4c0f4cf-013c-4888-a689-9c2315f2c96f req-7a486caa-892b-44c3-8272-f32eaec78b41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "231ee55e-2eb4-48b5-9f95-845118f6dbd6", "tag": "688cf221-c835-44dd-84c1-37bb5d407d77"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:33:52.378738 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-d4c0f4cf-013c-4888-a689-9c2315f2c96f req-7a486caa-892b-44c3-8272-f32eaec78b41 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:52.382128 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-d4c0f4cf-013c-4888-a689-9c2315f2c96f req-7a486caa-892b-44c3-8272-f32eaec78b41 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:52.401733 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-d4c0f4cf-013c-4888-a689-9c2315f2c96f req-7a486caa-892b-44c3-8272-f32eaec78b41 service nova] Creating event network-changed:688cf221-c835-44dd-84c1-37bb5d407d77 for instance 231ee55e-2eb4-48b5-9f95-845118f6dbd6 on hv-cinder-84932 Jul 12 17:33:52.407046 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-d4c0f4cf-013c-4888-a689-9c2315f2c96f req-7a486caa-892b-44c3-8272-f32eaec78b41 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048572 Jul 12 17:33:52.408201 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 405/834] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:33:52.449869 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-edd78552-2aef-418b-ad45-93a1d747b565 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "921571ea-fcfd-43ab-8470-12cd743cfd10"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:33:52.450933 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-edd78552-2aef-418b-ad45-93a1d747b565 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:52.457662 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-edd78552-2aef-418b-ad45-93a1d747b565 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:52.464333 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-edd78552-2aef-418b-ad45-93a1d747b565 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:52.465645 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-edd78552-2aef-418b-ad45-93a1d747b565 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:52.466501 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-edd78552-2aef-418b-ad45-93a1d747b565 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:52.482962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:52.872969 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-edd78552-2aef-418b-ad45-93a1d747b565 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "POST /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.427171 Jul 12 17:33:52.873566 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 430/835] 10.222.0.62 () {60 vars in 1322 bytes} [Tue Jul 12 17:33:52 2022] POST /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:33:53.019774 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1a2414bd-b132-4791-b77f-68d01bd9137d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:53.020476 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1a2414bd-b132-4791-b77f-68d01bd9137d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:53.026911 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1a2414bd-b132-4791-b77f-68d01bd9137d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:53.027257 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1a2414bd-b132-4791-b77f-68d01bd9137d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:53.028000 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1a2414bd-b132-4791-b77f-68d01bd9137d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:53.028430 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1a2414bd-b132-4791-b77f-68d01bd9137d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:53.163229 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1a2414bd-b132-4791-b77f-68d01bd9137d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:53.170855 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1a2414bd-b132-4791-b77f-68d01bd9137d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1266 microversion: 2.1 time: 0.155968 Jul 12 17:33:53.171419 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 406/836] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:53 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:54.188941 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-dad20b05-91be-4c99-960a-139cf7c5bd77 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:54.189559 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-dad20b05-91be-4c99-960a-139cf7c5bd77 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:54.196098 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dad20b05-91be-4c99-960a-139cf7c5bd77 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:54.196549 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dad20b05-91be-4c99-960a-139cf7c5bd77 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:54.197308 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dad20b05-91be-4c99-960a-139cf7c5bd77 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:54.197767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dad20b05-91be-4c99-960a-139cf7c5bd77 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:54.323599 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-dad20b05-91be-4c99-960a-139cf7c5bd77 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:54.330948 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-dad20b05-91be-4c99-960a-139cf7c5bd77 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1266 microversion: 2.1 time: 0.146753 Jul 12 17:33:54.331489 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 431/837] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:54 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:55.347392 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-68f76d14-0339-4301-a289-674a6dbcf28e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:55.348003 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-68f76d14-0339-4301-a289-674a6dbcf28e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:55.354434 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-68f76d14-0339-4301-a289-674a6dbcf28e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:55.354879 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-68f76d14-0339-4301-a289-674a6dbcf28e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:55.355627 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-68f76d14-0339-4301-a289-674a6dbcf28e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:55.356056 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-68f76d14-0339-4301-a289-674a6dbcf28e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:55.484257 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-68f76d14-0339-4301-a289-674a6dbcf28e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:55.492164 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-68f76d14-0339-4301-a289-674a6dbcf28e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1266 microversion: 2.1 time: 0.148571 Jul 12 17:33:55.492726 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 407/838] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:55 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:56.508191 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3a80c138-4870-495f-9991-39844336c16a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:56.508802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3a80c138-4870-495f-9991-39844336c16a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:56.511203 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:56.516815 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3a80c138-4870-495f-9991-39844336c16a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:56.517261 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3a80c138-4870-495f-9991-39844336c16a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:56.518050 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3a80c138-4870-495f-9991-39844336c16a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:56.518482 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3a80c138-4870-495f-9991-39844336c16a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:56.649306 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3a80c138-4870-495f-9991-39844336c16a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:56.656914 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3a80c138-4870-495f-9991-39844336c16a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1266 microversion: 2.1 time: 0.152567 Jul 12 17:33:56.657498 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 432/839] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:56 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:57.673372 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-18f7e7ad-ea62-497d-9c48-931d35cd8ed2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:57.674026 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-18f7e7ad-ea62-497d-9c48-931d35cd8ed2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:57.676541 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:57.677350 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=6 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:57.683699 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-18f7e7ad-ea62-497d-9c48-931d35cd8ed2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:57.684156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-18f7e7ad-ea62-497d-9c48-931d35cd8ed2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:57.684924 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-18f7e7ad-ea62-497d-9c48-931d35cd8ed2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:57.685364 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-18f7e7ad-ea62-497d-9c48-931d35cd8ed2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:57.818608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-18f7e7ad-ea62-497d-9c48-931d35cd8ed2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:57.825977 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-18f7e7ad-ea62-497d-9c48-931d35cd8ed2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1266 microversion: 2.1 time: 0.156477 Jul 12 17:33:57.826526 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 408/840] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:57 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:33:58.842664 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b44db747-b596-45bf-8bfb-e5acd3767297 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:33:58.843277 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b44db747-b596-45bf-8bfb-e5acd3767297 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:33:58.850145 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b44db747-b596-45bf-8bfb-e5acd3767297 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:58.850593 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b44db747-b596-45bf-8bfb-e5acd3767297 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:58.851348 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b44db747-b596-45bf-8bfb-e5acd3767297 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:33:58.851779 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b44db747-b596-45bf-8bfb-e5acd3767297 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:33:58.983446 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b44db747-b596-45bf-8bfb-e5acd3767297 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:33:58.990800 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b44db747-b596-45bf-8bfb-e5acd3767297 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1266 microversion: 2.1 time: 0.152147 Jul 12 17:33:58.991356 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 433/841] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:33:58 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:00.008003 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f74742fa-1a77-41d3-b74d-b8308b82e737 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:00.008621 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f74742fa-1a77-41d3-b74d-b8308b82e737 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:00.016225 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f74742fa-1a77-41d3-b74d-b8308b82e737 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:00.016753 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f74742fa-1a77-41d3-b74d-b8308b82e737 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:00.017654 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f74742fa-1a77-41d3-b74d-b8308b82e737 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:00.018120 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f74742fa-1a77-41d3-b74d-b8308b82e737 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:00.150298 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f74742fa-1a77-41d3-b74d-b8308b82e737 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:00.157677 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f74742fa-1a77-41d3-b74d-b8308b82e737 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1266 microversion: 2.1 time: 0.153477 Jul 12 17:34:00.158274 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 409/842] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:00 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:01.175289 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3e7ad727-2941-452a-b6da-eddbef46cab0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:01.175946 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3e7ad727-2941-452a-b6da-eddbef46cab0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:01.182369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3e7ad727-2941-452a-b6da-eddbef46cab0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:01.182841 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3e7ad727-2941-452a-b6da-eddbef46cab0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:01.183597 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3e7ad727-2941-452a-b6da-eddbef46cab0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:01.184032 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3e7ad727-2941-452a-b6da-eddbef46cab0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:01.314919 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3e7ad727-2941-452a-b6da-eddbef46cab0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:01.322457 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3e7ad727-2941-452a-b6da-eddbef46cab0 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1266 microversion: 2.1 time: 0.151088 Jul 12 17:34:01.323212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 434/843] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:01 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:02.339698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1c4982dc-c247-429c-be1b-1ba19c4c2958 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:02.340283 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1c4982dc-c247-429c-be1b-1ba19c4c2958 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:02.347265 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c4982dc-c247-429c-be1b-1ba19c4c2958 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:02.347705 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c4982dc-c247-429c-be1b-1ba19c4c2958 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:02.348461 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c4982dc-c247-429c-be1b-1ba19c4c2958 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:02.348916 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c4982dc-c247-429c-be1b-1ba19c4c2958 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:02.477303 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1c4982dc-c247-429c-be1b-1ba19c4c2958 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:02.484545 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1c4982dc-c247-429c-be1b-1ba19c4c2958 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1266 microversion: 2.1 time: 0.148710 Jul 12 17:34:02.485104 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 410/844] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:02 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:03.502057 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2aad78f7-3edf-44cc-aba7-ef5c71024468 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:03.502674 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2aad78f7-3edf-44cc-aba7-ef5c71024468 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:03.509340 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2aad78f7-3edf-44cc-aba7-ef5c71024468 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:03.509807 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2aad78f7-3edf-44cc-aba7-ef5c71024468 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:03.510568 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2aad78f7-3edf-44cc-aba7-ef5c71024468 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:03.510995 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2aad78f7-3edf-44cc-aba7-ef5c71024468 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:03.646773 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2aad78f7-3edf-44cc-aba7-ef5c71024468 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:03.655909 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2aad78f7-3edf-44cc-aba7-ef5c71024468 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1266 microversion: 2.1 time: 0.157041 Jul 12 17:34:03.656510 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 435/845] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:03 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:04.677657 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-eb2e0c7f-cbca-4a26-95fa-929d15f4a1b9 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:04.678322 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-eb2e0c7f-cbca-4a26-95fa-929d15f4a1b9 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:04.685492 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eb2e0c7f-cbca-4a26-95fa-929d15f4a1b9 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:04.686002 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eb2e0c7f-cbca-4a26-95fa-929d15f4a1b9 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:04.686763 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eb2e0c7f-cbca-4a26-95fa-929d15f4a1b9 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:04.687195 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eb2e0c7f-cbca-4a26-95fa-929d15f4a1b9 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:04.862775 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-eb2e0c7f-cbca-4a26-95fa-929d15f4a1b9 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:04.870576 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-eb2e0c7f-cbca-4a26-95fa-929d15f4a1b9 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1266 microversion: 2.1 time: 0.200990 Jul 12 17:34:04.871155 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 411/846] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:04 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:05.894780 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1c0ff65f-9a05-4237-a6db-95ce7bb8cfd3 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:05.895354 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1c0ff65f-9a05-4237-a6db-95ce7bb8cfd3 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:05.901313 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1c0ff65f-9a05-4237-a6db-95ce7bb8cfd3 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:05.901790 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1c0ff65f-9a05-4237-a6db-95ce7bb8cfd3 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:05.902556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1c0ff65f-9a05-4237-a6db-95ce7bb8cfd3 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:05.902989 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1c0ff65f-9a05-4237-a6db-95ce7bb8cfd3 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:06.036761 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1c0ff65f-9a05-4237-a6db-95ce7bb8cfd3 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:06.044052 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1c0ff65f-9a05-4237-a6db-95ce7bb8cfd3 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1266 microversion: 2.1 time: 0.153781 Jul 12 17:34:06.044637 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 436/847] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:05 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:06.678978 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7e953e92-d636-4b0a-bc90-e8c646e959b7 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "921571ea-fcfd-43ab-8470-12cd743cfd10"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:34:06.680041 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7e953e92-d636-4b0a-bc90-e8c646e959b7 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:06.686391 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7e953e92-d636-4b0a-bc90-e8c646e959b7 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:06.686835 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7e953e92-d636-4b0a-bc90-e8c646e959b7 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:06.687592 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7e953e92-d636-4b0a-bc90-e8c646e959b7 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:06.688023 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7e953e92-d636-4b0a-bc90-e8c646e959b7 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:06.766750 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-7e953e92-d636-4b0a-bc90-e8c646e959b7 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] HTTP exception thrown: Invalid volume: volume 921571ea-fcfd-43ab-8470-12cd743cfd10 is already attached to instances: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd Jul 12 17:34:06.768542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7e953e92-d636-4b0a-bc90-e8c646e959b7 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Request method failure captured: Jul 12 17:34:06.768542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: POST /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd/os-volume_attachments HTTP/1.1 Jul 12 17:34:06.768542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:34:06.768542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:34:06.768542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:34:06.768542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 74 Jul 12 17:34:06.768542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:34:06.768542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:34:06.768542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:34:06.768542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:34:06.768542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza6s95YbmpHGEF6KuEgm1a_bLJ81FwTpSTIH7MTxyWuinNdKpad_B8P_UZWneUdxW68SGH3Srj8_vZq-CuSnlwKSv16guwMSxTDbOGQyNs0XrVu8KfhrnvEOXIz2ODhAC95eTPACdOrc6qWclLz7G-TtlizrY4gQ1jWkpckM6H1sbeY Jul 12 17:34:06.768542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:34:06.768542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:34:06.768542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:34:06.768542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:34:06.768542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:34:06.768542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:34:06.768542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:34:06.768542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:34:06.768542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:34:06.768542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:34:06.770239 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4a4e837b171b4b4a9c2ad230cda53452", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:34:06.770239 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:34:06.770239 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:34:06.770239 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:34:06.770239 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:34:06.770239 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:34:06.770239 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:34:06.770239 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: 38a74ebdd59a491386aedcdbd312b363 Jul 12 17:34:06.770239 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:34:06.770239 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Jul 12 17:34:06.770239 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {"volumeAttachment": {"volumeId": "921571ea-fcfd-43ab-8470-12cd743cfd10"}} Jul 12 17:34:06.770239 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:34:06.771290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Invalid volume: volume 921571ea-fcfd-43ab-8470-12cd743cfd10 is already attached to instances: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd Jul 12 17:34:06.771290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'server_id': '58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd', 'body': {'volumeAttachment': {'volumeId': '921571ea-fcfd-43ab-8470-12cd743cfd10'}}} Jul 12 17:34:06.771290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:34:06.771290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:34:06.771290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 17:34:06.771290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 17:34:06.771290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 17:34:06.771290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 17:34:06.771290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 17:34:06.771290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 17:34:06.771290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 17:34:06.771290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 17:34:06.771290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 17:34:06.771290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 17:34:06.771290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 921571ea-fcfd-43ab-8470-12cd743cfd10 is already attached to instances: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd Jul 12 17:34:06.771290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:34:06.771290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:34:06.771290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:34:06.771290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:34:06.773368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:34:06.773368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:34:06.773368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:34:06.773368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:34:06.773368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:34:06.773368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:34:06.773368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 17:34:06.773368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:34:06.773368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 17:34:06.773368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:34:06.773368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 17:34:06.773368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 17:34:06.773368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 17:34:06.773368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 17:34:06.773368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 921571ea-fcfd-43ab-8470-12cd743cfd10 is already attached to instances: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd Jul 12 17:34:06.773368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:34:06.773368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:34:06.773368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:34:06.773368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:34:06.773368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:34:06.774920 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:34:06.774920 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:34:06.774920 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:34:06.774920 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 921571ea-fcfd-43ab-8470-12cd743cfd10 is already attached to instances: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd Jul 12 17:34:06.774920 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:34:06.774920 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7e953e92-d636-4b0a-bc90-e8c646e959b7 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Returning 400 to user: Invalid volume: volume 921571ea-fcfd-43ab-8470-12cd743cfd10 is already attached to instances: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:34:06.774920 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7e953e92-d636-4b0a-bc90-e8c646e959b7 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "POST /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095464 Jul 12 17:34:06.774920 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 412/848] 10.222.0.62 () {60 vars in 1322 bytes} [Tue Jul 12 17:34:06 2022] POST /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 17:34:06.831127 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2be3d89b-bfc9-4d65-b070-1fcaf990201d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:06.831615 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2be3d89b-bfc9-4d65-b070-1fcaf990201d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:06.837558 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2be3d89b-bfc9-4d65-b070-1fcaf990201d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:06.838033 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2be3d89b-bfc9-4d65-b070-1fcaf990201d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:06.838781 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2be3d89b-bfc9-4d65-b070-1fcaf990201d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:06.839208 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2be3d89b-bfc9-4d65-b070-1fcaf990201d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:06.916154 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-2be3d89b-bfc9-4d65-b070-1fcaf990201d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lazy-loading 'services' on Instance uuid 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:34:06.986322 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2be3d89b-bfc9-4d65-b070-1fcaf990201d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "DELETE /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd/os-volume_attachments/921571ea-fcfd-43ab-8470-12cd743cfd10" status: 202 len: 0 microversion: 2.1 time: 0.158880 Jul 12 17:34:06.986936 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 437/849] 10.222.0.62 () {58 vars in 1415 bytes} [Tue Jul 12 17:34:06 2022] DELETE /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd/os-volume_attachments/921571ea-fcfd-43ab-8470-12cd743cfd10 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:34:06.996222 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-bc58be38-8432-4a53-8725-7670079fc2ed tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:06.997133 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-bc58be38-8432-4a53-8725-7670079fc2ed tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:07.003258 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bc58be38-8432-4a53-8725-7670079fc2ed tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:07.003699 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bc58be38-8432-4a53-8725-7670079fc2ed tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:07.004458 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bc58be38-8432-4a53-8725-7670079fc2ed tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:07.004889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bc58be38-8432-4a53-8725-7670079fc2ed tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:07.036394 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-bc58be38-8432-4a53-8725-7670079fc2ed tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044117 Jul 12 17:34:07.036943 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 413/850] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:34:06 2022] GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:34:07.060533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-dd88a5fd-9d72-4d62-a7ea-2a39768ca3b6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:07.061233 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-dd88a5fd-9d72-4d62-a7ea-2a39768ca3b6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:07.067798 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dd88a5fd-9d72-4d62-a7ea-2a39768ca3b6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:07.068243 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dd88a5fd-9d72-4d62-a7ea-2a39768ca3b6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:07.069006 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dd88a5fd-9d72-4d62-a7ea-2a39768ca3b6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:07.069444 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dd88a5fd-9d72-4d62-a7ea-2a39768ca3b6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:07.202804 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-dd88a5fd-9d72-4d62-a7ea-2a39768ca3b6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:07.210734 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-dd88a5fd-9d72-4d62-a7ea-2a39768ca3b6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1266 microversion: 2.1 time: 0.154342 Jul 12 17:34:07.211307 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 438/851] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:07 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:08.048934 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7882db09-c9d0-4e12-a156-c6ec17cd13be tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:08.051130 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7882db09-c9d0-4e12-a156-c6ec17cd13be tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:08.058375 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7882db09-c9d0-4e12-a156-c6ec17cd13be tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:08.059158 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7882db09-c9d0-4e12-a156-c6ec17cd13be tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:08.059941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7882db09-c9d0-4e12-a156-c6ec17cd13be tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:08.060383 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7882db09-c9d0-4e12-a156-c6ec17cd13be tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:08.091754 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7882db09-c9d0-4e12-a156-c6ec17cd13be tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047348 Jul 12 17:34:08.092336 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 414/852] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:34:08 2022] GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:34:08.227864 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3cf80fb2-d435-4fb6-bbc7-7e24fc78f1ae tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:08.228504 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3cf80fb2-d435-4fb6-bbc7-7e24fc78f1ae tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:08.234880 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3cf80fb2-d435-4fb6-bbc7-7e24fc78f1ae tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:08.235330 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3cf80fb2-d435-4fb6-bbc7-7e24fc78f1ae tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:08.236080 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3cf80fb2-d435-4fb6-bbc7-7e24fc78f1ae tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:08.236518 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3cf80fb2-d435-4fb6-bbc7-7e24fc78f1ae tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:08.364073 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3cf80fb2-d435-4fb6-bbc7-7e24fc78f1ae tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:08.371370 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3cf80fb2-d435-4fb6-bbc7-7e24fc78f1ae tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1266 microversion: 2.1 time: 0.147370 Jul 12 17:34:08.371924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 439/853] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:08 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:09.103923 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-27894fc4-dec6-4ec6-9d13-935e3c3b7701 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:09.104859 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-27894fc4-dec6-4ec6-9d13-935e3c3b7701 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:09.111541 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-27894fc4-dec6-4ec6-9d13-935e3c3b7701 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:09.111822 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-27894fc4-dec6-4ec6-9d13-935e3c3b7701 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:09.112987 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-27894fc4-dec6-4ec6-9d13-935e3c3b7701 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:09.113433 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-27894fc4-dec6-4ec6-9d13-935e3c3b7701 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:09.145199 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-27894fc4-dec6-4ec6-9d13-935e3c3b7701 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045181 Jul 12 17:34:09.145679 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 415/854] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:34:09 2022] GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 17:34:09.207564 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-dd09157d-4938-4f69-b921-dc01165f552d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:09.208067 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-dd09157d-4938-4f69-b921-dc01165f552d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:09.214230 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dd09157d-4938-4f69-b921-dc01165f552d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:09.214681 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dd09157d-4938-4f69-b921-dc01165f552d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:09.215470 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dd09157d-4938-4f69-b921-dc01165f552d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:09.215905 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dd09157d-4938-4f69-b921-dc01165f552d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:09.240168 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-dd09157d-4938-4f69-b921-dc01165f552d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:34:09.312994 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-dd09157d-4938-4f69-b921-dc01165f552d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "DELETE /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd" status: 204 len: 0 microversion: 2.1 time: 0.109353 Jul 12 17:34:09.313822 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 440/855] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:34:09 2022] DELETE /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:34:09.323134 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2d391bed-f890-4063-87a7-92b0394fe1e5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:09.323745 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2d391bed-f890-4063-87a7-92b0394fe1e5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:09.329653 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2d391bed-f890-4063-87a7-92b0394fe1e5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:09.330134 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2d391bed-f890-4063-87a7-92b0394fe1e5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:09.331568 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2d391bed-f890-4063-87a7-92b0394fe1e5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:09.332005 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2d391bed-f890-4063-87a7-92b0394fe1e5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:09.388948 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-53c29938-6ad4-4dbd-b98b-019fb6f2155d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:09.389882 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-53c29938-6ad4-4dbd-b98b-019fb6f2155d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:09.396031 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53c29938-6ad4-4dbd-b98b-019fb6f2155d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:09.396408 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53c29938-6ad4-4dbd-b98b-019fb6f2155d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:09.397177 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53c29938-6ad4-4dbd-b98b-019fb6f2155d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:09.397608 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53c29938-6ad4-4dbd-b98b-019fb6f2155d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:09.507068 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2d391bed-f890-4063-87a7-92b0394fe1e5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:09.515284 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2d391bed-f890-4063-87a7-92b0394fe1e5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd" status: 200 len: 1680 microversion: 2.1 time: 0.195991 Jul 12 17:34:09.515854 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 416/856] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:09 2022] GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd => generated 1680 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:09.551906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-53c29938-6ad4-4dbd-b98b-019fb6f2155d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:09.559339 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-53c29938-6ad4-4dbd-b98b-019fb6f2155d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1266 microversion: 2.1 time: 0.174965 Jul 12 17:34:09.559901 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 441/857] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:09 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:34:10.532466 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-533e9c92-7ba5-4a98-aa2a-4371522e681b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:10.533083 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-533e9c92-7ba5-4a98-aa2a-4371522e681b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:10.541437 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-533e9c92-7ba5-4a98-aa2a-4371522e681b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:10.542126 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-533e9c92-7ba5-4a98-aa2a-4371522e681b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:10.542903 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-533e9c92-7ba5-4a98-aa2a-4371522e681b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:10.543340 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-533e9c92-7ba5-4a98-aa2a-4371522e681b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:10.548723 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:34:10.580093 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f5279aa7-94cd-4230-92f6-35a3ca46a471 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:10.581755 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f5279aa7-94cd-4230-92f6-35a3ca46a471 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:10.592953 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f5279aa7-94cd-4230-92f6-35a3ca46a471 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:10.594205 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f5279aa7-94cd-4230-92f6-35a3ca46a471 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:10.597914 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f5279aa7-94cd-4230-92f6-35a3ca46a471 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:10.597914 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f5279aa7-94cd-4230-92f6-35a3ca46a471 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:10.775898 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-533e9c92-7ba5-4a98-aa2a-4371522e681b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:10.784972 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-533e9c92-7ba5-4a98-aa2a-4371522e681b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd" status: 200 len: 1680 microversion: 2.1 time: 0.256223 Jul 12 17:34:10.786154 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 417/858] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:10 2022] GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd => generated 1680 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:10.816837 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f5279aa7-94cd-4230-92f6-35a3ca46a471 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:10.828640 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f5279aa7-94cd-4230-92f6-35a3ca46a471 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1266 microversion: 2.1 time: 0.254150 Jul 12 17:34:10.829717 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 442/859] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:10 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:34:11.114603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-5735b35e-e4b4-4afb-a81c-e83e909282c4 req-1ff0c6a0-7491-4b99-97cc-c13205a5e5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "231ee55e-2eb4-48b5-9f95-845118f6dbd6", "name": "network-vif-plugged", "status": "completed", "tag": "688cf221-c835-44dd-84c1-37bb5d407d77"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:34:11.123599 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-5735b35e-e4b4-4afb-a81c-e83e909282c4 req-1ff0c6a0-7491-4b99-97cc-c13205a5e5f8 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:11.124193 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-5735b35e-e4b4-4afb-a81c-e83e909282c4 req-1ff0c6a0-7491-4b99-97cc-c13205a5e5f8 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:11.135822 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-5735b35e-e4b4-4afb-a81c-e83e909282c4 req-1ff0c6a0-7491-4b99-97cc-c13205a5e5f8 service nova] Creating event network-vif-plugged:688cf221-c835-44dd-84c1-37bb5d407d77 for instance 231ee55e-2eb4-48b5-9f95-845118f6dbd6 on hv-cinder-84932 Jul 12 17:34:11.140900 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-5735b35e-e4b4-4afb-a81c-e83e909282c4 req-1ff0c6a0-7491-4b99-97cc-c13205a5e5f8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031065 Jul 12 17:34:11.141452 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 418/860] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:34:11.802113 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f23f3455-1a7d-4874-81ee-373f6a711030 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:11.802853 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f23f3455-1a7d-4874-81ee-373f6a711030 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:11.809247 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f23f3455-1a7d-4874-81ee-373f6a711030 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:11.809794 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f23f3455-1a7d-4874-81ee-373f6a711030 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:11.810618 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f23f3455-1a7d-4874-81ee-373f6a711030 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:11.811136 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f23f3455-1a7d-4874-81ee-373f6a711030 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:11.815170 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:34:11.848759 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-08edfa22-3db8-4c0f-a545-6963294c07e1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:11.849544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-08edfa22-3db8-4c0f-a545-6963294c07e1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:11.856043 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08edfa22-3db8-4c0f-a545-6963294c07e1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:11.856567 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08edfa22-3db8-4c0f-a545-6963294c07e1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:11.857344 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08edfa22-3db8-4c0f-a545-6963294c07e1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:11.857803 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08edfa22-3db8-4c0f-a545-6963294c07e1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:12.368715 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f23f3455-1a7d-4874-81ee-373f6a711030 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:12.374593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-08edfa22-3db8-4c0f-a545-6963294c07e1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:12.379154 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f23f3455-1a7d-4874-81ee-373f6a711030 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd" status: 200 len: 1680 microversion: 2.1 time: 0.580858 Jul 12 17:34:12.380289 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 443/861] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:11 2022] GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd => generated 1680 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:12.383904 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-08edfa22-3db8-4c0f-a545-6963294c07e1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1266 microversion: 2.1 time: 0.540940 Jul 12 17:34:12.384476 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 419/862] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:11 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1266 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:12.811302 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-269a3ff4-9dc6-4a27-9002-aeb7717d03bd req-1557d7ea-addc-4652-968b-4f167ac7d6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd", "name": "network-vif-deleted", "tag": "0275e39e-f41d-4e49-99a5-e8873ed3df6d"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:34:12.821092 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-269a3ff4-9dc6-4a27-9002-aeb7717d03bd req-1557d7ea-addc-4652-968b-4f167ac7d6e7 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:12.821802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-269a3ff4-9dc6-4a27-9002-aeb7717d03bd req-1557d7ea-addc-4652-968b-4f167ac7d6e7 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:12.834720 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-269a3ff4-9dc6-4a27-9002-aeb7717d03bd req-1557d7ea-addc-4652-968b-4f167ac7d6e7 service nova] Creating event network-vif-deleted:0275e39e-f41d-4e49-99a5-e8873ed3df6d for instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd on hv-cinder-84932 Jul 12 17:34:12.840140 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-269a3ff4-9dc6-4a27-9002-aeb7717d03bd req-1557d7ea-addc-4652-968b-4f167ac7d6e7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032520 Jul 12 17:34:12.841296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 444/863] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:34:13.397087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-abf8028f-4ed7-47b6-aece-95722090557e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:13.399109 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-abf8028f-4ed7-47b6-aece-95722090557e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:13.405895 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-66d149db-e979-464d-b5bb-f1977c39ab8b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:13.406600 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-66d149db-e979-464d-b5bb-f1977c39ab8b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:13.406938 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-abf8028f-4ed7-47b6-aece-95722090557e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:13.407865 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-abf8028f-4ed7-47b6-aece-95722090557e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:13.408894 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-abf8028f-4ed7-47b6-aece-95722090557e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:13.409537 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-abf8028f-4ed7-47b6-aece-95722090557e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:13.410904 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:34:13.415382 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66d149db-e979-464d-b5bb-f1977c39ab8b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:13.415665 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66d149db-e979-464d-b5bb-f1977c39ab8b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:13.416615 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66d149db-e979-464d-b5bb-f1977c39ab8b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:13.417218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66d149db-e979-464d-b5bb-f1977c39ab8b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:13.470299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-abf8028f-4ed7-47b6-aece-95722090557e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:13.476497 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-abf8028f-4ed7-47b6-aece-95722090557e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:13.477465 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-abf8028f-4ed7-47b6-aece-95722090557e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lazy-loading 'fault' on Instance uuid 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:34:13.555612 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-abf8028f-4ed7-47b6-aece-95722090557e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:13.567205 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-abf8028f-4ed7-47b6-aece-95722090557e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd" status: 200 len: 1330 microversion: 2.1 time: 0.174249 Jul 12 17:34:13.568664 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 420/864] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:13 2022] GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd => generated 1330 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:13.629492 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-66d149db-e979-464d-b5bb-f1977c39ab8b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:13.641171 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-66d149db-e979-464d-b5bb-f1977c39ab8b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1453 microversion: 2.1 time: 0.244098 Jul 12 17:34:13.641775 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 445/865] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:13 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1453 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:34:13.658358 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e92d9832-b174-4d38-b236-b851c6c480fa tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:13.659683 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e92d9832-b174-4d38-b236-b851c6c480fa tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:13.669991 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e92d9832-b174-4d38-b236-b851c6c480fa tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:13.670600 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e92d9832-b174-4d38-b236-b851c6c480fa tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:13.671382 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e92d9832-b174-4d38-b236-b851c6c480fa tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:13.671872 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e92d9832-b174-4d38-b236-b851c6c480fa tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:13.828416 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e92d9832-b174-4d38-b236-b851c6c480fa tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:13.841661 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e92d9832-b174-4d38-b236-b851c6c480fa tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1453 microversion: 2.1 time: 0.188299 Jul 12 17:34:13.842605 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 421/866] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:13 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1453 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:14.585032 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cdc55ba0-5002-48d6-b9e8-996ebc7be86c tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:14.585715 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cdc55ba0-5002-48d6-b9e8-996ebc7be86c tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:14.593334 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cdc55ba0-5002-48d6-b9e8-996ebc7be86c tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:14.594066 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cdc55ba0-5002-48d6-b9e8-996ebc7be86c tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:14.595109 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cdc55ba0-5002-48d6-b9e8-996ebc7be86c tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:14.595688 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cdc55ba0-5002-48d6-b9e8-996ebc7be86c tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:14.610485 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-cdc55ba0-5002-48d6-b9e8-996ebc7be86c tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] HTTP exception thrown: Instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd could not be found. Jul 12 17:34:14.613838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cdc55ba0-5002-48d6-b9e8-996ebc7be86c tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Request method failure captured: Jul 12 17:34:14.613838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd HTTP/1.1 Jul 12 17:34:14.613838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:34:14.613838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:34:14.613838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:34:14.613838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:34:14.613838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:34:14.613838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:34:14.613838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:34:14.613838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:34:14.613838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza6s95YbmpHGEF6KuEgm1a_bLJ81FwTpSTIH7MTxyWuinNdKpad_B8P_UZWneUdxW68SGH3Srj8_vZq-CuSnlwKSv16guwMSxTDbOGQyNs0XrVu8KfhrnvEOXIz2ODhAC95eTPACdOrc6qWclLz7G-TtlizrY4gQ1jWkpckM6H1sbeY Jul 12 17:34:14.613838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:34:14.613838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:34:14.613838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:34:14.613838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:34:14.613838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:34:14.613838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:34:14.613838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:34:14.613838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:34:14.613838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:34:14.613838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:34:14.615299 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4a4e837b171b4b4a9c2ad230cda53452", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:34:14.615299 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:34:14.615299 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:34:14.615299 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:34:14.615299 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:34:14.615299 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:34:14.615299 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:34:14.615299 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: 38a74ebdd59a491386aedcdbd312b363 Jul 12 17:34:14.615299 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:34:14.615299 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:34:14.615299 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd could not be found. Jul 12 17:34:14.615299 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': '58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd'} Jul 12 17:34:14.616369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:34:14.616369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:34:14.616369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:34:14.616369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:34:14.616369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:34:14.616369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:34:14.616369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:34:14.616369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:34:14.616369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:34:14.616369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:34:14.616369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd could not be found. Jul 12 17:34:14.616369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:34:14.616369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:34:14.616369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:34:14.616369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:34:14.616369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:34:14.616369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:34:14.616369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:34:14.616369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:34:14.616369 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:34:14.617633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:34:14.617633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:34:14.617633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:34:14.617633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:34:14.617633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:34:14.617633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:34:14.617633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:34:14.617633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd could not be found. Jul 12 17:34:14.617633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:34:14.617633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:34:14.617633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:34:14.617633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:34:14.617633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:34:14.617633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:34:14.617633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:34:14.617633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:34:14.617633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd could not be found. Jul 12 17:34:14.617633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:34:14.618851 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cdc55ba0-5002-48d6-b9e8-996ebc7be86c tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Returning 404 to user: Instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:34:14.618851 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cdc55ba0-5002-48d6-b9e8-996ebc7be86c tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd" status: 404 len: 111 microversion: 2.1 time: 0.034782 Jul 12 17:34:14.618851 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 446/867] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:14 2022] GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:34:14.623860 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-772a0c57-e90c-4d1f-9cfc-19c51755ab8f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '.version_select at 0x7f872978b040>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:14.643663 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-772a0c57-e90c-4d1f-9cfc-19c51755ab8f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-296589947" status: 202 len: 0 microversion: 2.1 time: 0.022851 Jul 12 17:34:14.644664 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 422/868] 10.222.0.62 () {58 vars in 1217 bytes} [Tue Jul 12 17:34:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-296589947 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:34:15.689371 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-08fbcf8a-a21c-4d50-bbb0-a9741ddab0f3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Action: 'create', calling method: .version_select at 0x7f872e1cdd30>, body: {"keypair": {"name": "tempest-keypair-837305579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTi4QFN5V2in8Hzsjl1ixZPbvfUQBFWtkF0lIOwQYn+2VRMbhMFlatON6jX7L3JNa9GTbK53C5mYVhcNgA/+yTjvz/HXtbWjUu5+PXMkKip8ogxrqKGvXDhS5iPa2qSDA=="}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:34:15.704236 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-08fbcf8a-a21c-4d50-bbb0-a9741ddab0f3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Getting quotas for project 4a4e837b171b4b4a9c2ad230cda53452. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:34:15.709424 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-08fbcf8a-a21c-4d50-bbb0-a9741ddab0f3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Getting quotas for user 38a74ebdd59a491386aedcdbd312b363 and project 4a4e837b171b4b4a9c2ad230cda53452. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:34:15.741399 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-08fbcf8a-a21c-4d50-bbb0-a9741ddab0f3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055971 Jul 12 17:34:15.742240 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 447/869] 10.222.0.62 () {60 vars in 1158 bytes} [Tue Jul 12 17:34:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:34:16.121022 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-76116820-105b-4542-afaf-53f7c10ecf14 req-97cd6658-0808-4dab-b06d-7ca1d703c890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "231ee55e-2eb4-48b5-9f95-845118f6dbd6", "tag": "688cf221-c835-44dd-84c1-37bb5d407d77"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:34:16.133322 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-76116820-105b-4542-afaf-53f7c10ecf14 req-97cd6658-0808-4dab-b06d-7ca1d703c890 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:16.134219 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-76116820-105b-4542-afaf-53f7c10ecf14 req-97cd6658-0808-4dab-b06d-7ca1d703c890 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:16.146585 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-76116820-105b-4542-afaf-53f7c10ecf14 req-97cd6658-0808-4dab-b06d-7ca1d703c890 service nova] Creating event network-changed:688cf221-c835-44dd-84c1-37bb5d407d77 for instance 231ee55e-2eb4-48b5-9f95-845118f6dbd6 on hv-cinder-84932 Jul 12 17:34:16.152619 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-76116820-105b-4542-afaf-53f7c10ecf14 req-97cd6658-0808-4dab-b06d-7ca1d703c890 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035398 Jul 12 17:34:16.154118 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 423/870] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:34:17.224507 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c57d63e0-3d08-4342-aba8-8bd2404313f8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-306453018", "imageRef": "b19e7830-75c9-4706-bd34-4954ba6b4cc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3be9cb9-0ea5-4d05-b64b-1defd294a562"}], "security_groups": [{"name": "tempest-securitygroup--2008469064"}], "key_name": "tempest-keypair-837305579", "user_data": "}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:34:17.329504 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-c57d63e0-3d08-4342-aba8-8bd2404313f8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] validate_networks() for [('e3be9cb9-0ea5-4d05-b64b-1defd294a562', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:34:17.724777 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-c57d63e0-3d08-4342-aba8-8bd2404313f8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:34:17.725199 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-c57d63e0-3d08-4342-aba8-8bd2404313f8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:34:17.725672 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-c57d63e0-3d08-4342-aba8-8bd2404313f8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:34:17.726170 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-c57d63e0-3d08-4342-aba8-8bd2404313f8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:34:17.726589 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-c57d63e0-3d08-4342-aba8-8bd2404313f8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:34:17.737206 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c57d63e0-3d08-4342-aba8-8bd2404313f8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:17.737654 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c57d63e0-3d08-4342-aba8-8bd2404313f8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:17.738572 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c57d63e0-3d08-4342-aba8-8bd2404313f8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:17.739009 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c57d63e0-3d08-4342-aba8-8bd2404313f8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:17.762349 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-c57d63e0-3d08-4342-aba8-8bd2404313f8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Getting quotas for project 4a4e837b171b4b4a9c2ad230cda53452. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:34:17.766365 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-c57d63e0-3d08-4342-aba8-8bd2404313f8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Getting quotas for user 38a74ebdd59a491386aedcdbd312b363 and project 4a4e837b171b4b4a9c2ad230cda53452. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:34:17.777262 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c57d63e0-3d08-4342-aba8-8bd2404313f8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:34:17.779569 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c57d63e0-3d08-4342-aba8-8bd2404313f8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19e7830-75c9-4706-bd34-4954ba6b4cc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:34:17.825891 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c57d63e0-3d08-4342-aba8-8bd2404313f8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.606835 Jul 12 17:34:17.826533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 448/871] 10.222.0.62 () {60 vars in 1146 bytes} [Tue Jul 12 17:34:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:34:17.837467 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-08d36ef2-f649-4735-ac48-3443bebb5ccb tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:17.838196 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-08d36ef2-f649-4735-ac48-3443bebb5ccb tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:17.892436 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-08d36ef2-f649-4735-ac48-3443bebb5ccb tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:17.899302 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-08d36ef2-f649-4735-ac48-3443bebb5ccb tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1240 microversion: 2.1 time: 0.066481 Jul 12 17:34:17.899935 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 424/872] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:17 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:18.918857 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ea239836-d8c5-4309-8c0a-5ad38fe46579 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:18.920801 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ea239836-d8c5-4309-8c0a-5ad38fe46579 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:18.928774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ea239836-d8c5-4309-8c0a-5ad38fe46579 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:18.929252 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ea239836-d8c5-4309-8c0a-5ad38fe46579 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:18.930290 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ea239836-d8c5-4309-8c0a-5ad38fe46579 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:18.930886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ea239836-d8c5-4309-8c0a-5ad38fe46579 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:19.011421 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ea239836-d8c5-4309-8c0a-5ad38fe46579 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:19.024541 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ea239836-d8c5-4309-8c0a-5ad38fe46579 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1298 microversion: 2.1 time: 0.111676 Jul 12 17:34:19.025188 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 449/873] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:18 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1298 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:20.041153 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c9a8ceb6-ab1f-43d4-916d-b779b7d61183 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:20.041807 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c9a8ceb6-ab1f-43d4-916d-b779b7d61183 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:20.045597 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:34:20.050964 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c9a8ceb6-ab1f-43d4-916d-b779b7d61183 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:20.051546 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c9a8ceb6-ab1f-43d4-916d-b779b7d61183 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:20.052411 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c9a8ceb6-ab1f-43d4-916d-b779b7d61183 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:20.052852 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c9a8ceb6-ab1f-43d4-916d-b779b7d61183 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:20.264759 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c9a8ceb6-ab1f-43d4-916d-b779b7d61183 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:20.272858 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c9a8ceb6-ab1f-43d4-916d-b779b7d61183 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1366 microversion: 2.1 time: 0.235932 Jul 12 17:34:20.273417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 425/874] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:20 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:34:20.395097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-ea20ecb8-8360-4ba6-b8a8-1382be608c05 req-e257cb72-4dca-444d-9e2a-c6fa6062e757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e50bdd-3716-421f-b6ca-832ee1f63c42", "tag": "252a7740-2a5f-4b94-9778-971825115baf"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:34:20.404656 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-ea20ecb8-8360-4ba6-b8a8-1382be608c05 req-e257cb72-4dca-444d-9e2a-c6fa6062e757 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:20.405300 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-ea20ecb8-8360-4ba6-b8a8-1382be608c05 req-e257cb72-4dca-444d-9e2a-c6fa6062e757 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:20.421936 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-ea20ecb8-8360-4ba6-b8a8-1382be608c05 req-e257cb72-4dca-444d-9e2a-c6fa6062e757 service nova] Creating event network-changed:252a7740-2a5f-4b94-9778-971825115baf for instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 on hv-cinder-84932 Jul 12 17:34:20.427550 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-ea20ecb8-8360-4ba6-b8a8-1382be608c05 req-e257cb72-4dca-444d-9e2a-c6fa6062e757 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037281 Jul 12 17:34:20.428426 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 450/875] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:34:21.289082 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d6407378-6aa4-42dd-98eb-e749ab20d1f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:21.289850 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d6407378-6aa4-42dd-98eb-e749ab20d1f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:21.296206 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d6407378-6aa4-42dd-98eb-e749ab20d1f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:21.296651 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d6407378-6aa4-42dd-98eb-e749ab20d1f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:21.297410 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d6407378-6aa4-42dd-98eb-e749ab20d1f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:21.297965 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d6407378-6aa4-42dd-98eb-e749ab20d1f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:21.482306 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d6407378-6aa4-42dd-98eb-e749ab20d1f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:21.489770 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d6407378-6aa4-42dd-98eb-e749ab20d1f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1366 microversion: 2.1 time: 0.204455 Jul 12 17:34:21.490346 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 426/876] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:21 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:22.508243 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-75a93548-25f8-4080-ad13-932b6cf34cbc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:22.509036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-75a93548-25f8-4080-ad13-932b6cf34cbc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:22.515370 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75a93548-25f8-4080-ad13-932b6cf34cbc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:22.515816 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75a93548-25f8-4080-ad13-932b6cf34cbc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:22.516575 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75a93548-25f8-4080-ad13-932b6cf34cbc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:22.516998 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-75a93548-25f8-4080-ad13-932b6cf34cbc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:22.663554 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-75a93548-25f8-4080-ad13-932b6cf34cbc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:22.670896 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-75a93548-25f8-4080-ad13-932b6cf34cbc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1366 microversion: 2.1 time: 0.167297 Jul 12 17:34:22.671714 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 451/877] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:22 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:23.688438 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-bc6b83ed-6c64-41dd-81b7-d580838d4401 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:23.689052 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-bc6b83ed-6c64-41dd-81b7-d580838d4401 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:23.696497 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bc6b83ed-6c64-41dd-81b7-d580838d4401 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:23.696940 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bc6b83ed-6c64-41dd-81b7-d580838d4401 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:23.697726 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bc6b83ed-6c64-41dd-81b7-d580838d4401 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:23.698170 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bc6b83ed-6c64-41dd-81b7-d580838d4401 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:23.824531 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-bc6b83ed-6c64-41dd-81b7-d580838d4401 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:23.831862 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-bc6b83ed-6c64-41dd-81b7-d580838d4401 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1366 microversion: 2.1 time: 0.147447 Jul 12 17:34:23.832418 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 427/878] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:23 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:24.848361 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-73cf4cbc-e90f-464b-b4fe-5b8fbac498f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:24.848963 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-73cf4cbc-e90f-464b-b4fe-5b8fbac498f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:24.855463 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-73cf4cbc-e90f-464b-b4fe-5b8fbac498f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:24.855909 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-73cf4cbc-e90f-464b-b4fe-5b8fbac498f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:24.856660 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-73cf4cbc-e90f-464b-b4fe-5b8fbac498f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:24.857091 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-73cf4cbc-e90f-464b-b4fe-5b8fbac498f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:24.981885 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-73cf4cbc-e90f-464b-b4fe-5b8fbac498f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:24.989252 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-73cf4cbc-e90f-464b-b4fe-5b8fbac498f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1366 microversion: 2.1 time: 0.145212 Jul 12 17:34:24.989826 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 452/879] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:24 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:26.006285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6cfc6b87-5c11-4de5-ae93-3fdf395bae3f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:26.006855 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6cfc6b87-5c11-4de5-ae93-3fdf395bae3f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:26.013338 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6cfc6b87-5c11-4de5-ae93-3fdf395bae3f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:26.013813 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6cfc6b87-5c11-4de5-ae93-3fdf395bae3f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:26.014578 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6cfc6b87-5c11-4de5-ae93-3fdf395bae3f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:26.015011 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6cfc6b87-5c11-4de5-ae93-3fdf395bae3f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:26.386573 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6cfc6b87-5c11-4de5-ae93-3fdf395bae3f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:26.394585 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6cfc6b87-5c11-4de5-ae93-3fdf395bae3f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1366 microversion: 2.1 time: 0.392354 Jul 12 17:34:26.395145 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 428/880] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:26 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1366 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:27.411716 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-05a58d09-b63c-4b08-88ad-9849a3fe93b9 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:27.412326 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-05a58d09-b63c-4b08-88ad-9849a3fe93b9 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:27.418793 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-05a58d09-b63c-4b08-88ad-9849a3fe93b9 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:27.419237 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-05a58d09-b63c-4b08-88ad-9849a3fe93b9 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:27.419994 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-05a58d09-b63c-4b08-88ad-9849a3fe93b9 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:27.420427 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-05a58d09-b63c-4b08-88ad-9849a3fe93b9 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:27.547608 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-05a58d09-b63c-4b08-88ad-9849a3fe93b9 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:27.554905 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-05a58d09-b63c-4b08-88ad-9849a3fe93b9 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1366 microversion: 2.1 time: 0.147655 Jul 12 17:34:27.555461 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 453/881] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:27 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:28.571563 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ed2e1a23-bcf1-4164-aeb3-c43b248ee18b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:28.572116 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ed2e1a23-bcf1-4164-aeb3-c43b248ee18b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:28.574393 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:34:28.579752 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ed2e1a23-bcf1-4164-aeb3-c43b248ee18b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:28.580200 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ed2e1a23-bcf1-4164-aeb3-c43b248ee18b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:28.580973 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ed2e1a23-bcf1-4164-aeb3-c43b248ee18b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:28.581411 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ed2e1a23-bcf1-4164-aeb3-c43b248ee18b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:28.861078 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ed2e1a23-bcf1-4164-aeb3-c43b248ee18b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:28.868670 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ed2e1a23-bcf1-4164-aeb3-c43b248ee18b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1366 microversion: 2.1 time: 0.300976 Jul 12 17:34:28.869474 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 429/882] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:28 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:29.885667 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-00982875-c62f-4f38-b56c-fa7b94f64fbc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:29.886305 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-00982875-c62f-4f38-b56c-fa7b94f64fbc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:29.888214 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:34:29.888880 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=10 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:34:29.895214 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00982875-c62f-4f38-b56c-fa7b94f64fbc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:29.895664 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00982875-c62f-4f38-b56c-fa7b94f64fbc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:29.896424 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00982875-c62f-4f38-b56c-fa7b94f64fbc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:29.896863 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-00982875-c62f-4f38-b56c-fa7b94f64fbc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:30.021863 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-00982875-c62f-4f38-b56c-fa7b94f64fbc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:30.029267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-00982875-c62f-4f38-b56c-fa7b94f64fbc tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1366 microversion: 2.1 time: 0.147376 Jul 12 17:34:30.029866 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 454/883] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:29 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:31.046569 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e2f4195f-41d6-45f6-b889-615a268a87f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:31.047186 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e2f4195f-41d6-45f6-b889-615a268a87f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:31.053727 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e2f4195f-41d6-45f6-b889-615a268a87f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:31.054183 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e2f4195f-41d6-45f6-b889-615a268a87f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:31.054951 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e2f4195f-41d6-45f6-b889-615a268a87f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:31.055389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e2f4195f-41d6-45f6-b889-615a268a87f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:31.184043 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e2f4195f-41d6-45f6-b889-615a268a87f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:31.192394 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e2f4195f-41d6-45f6-b889-615a268a87f0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1366 microversion: 2.1 time: 0.149402 Jul 12 17:34:31.192948 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 430/884] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:31 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:34:32.209785 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ce8d3178-3323-4b5f-9eb3-916572d9ea5d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:32.210399 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ce8d3178-3323-4b5f-9eb3-916572d9ea5d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:32.216903 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ce8d3178-3323-4b5f-9eb3-916572d9ea5d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:32.217357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ce8d3178-3323-4b5f-9eb3-916572d9ea5d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:32.218145 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ce8d3178-3323-4b5f-9eb3-916572d9ea5d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:32.218588 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ce8d3178-3323-4b5f-9eb3-916572d9ea5d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:32.266923 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-cf48f7be-79d7-429f-8f61-e32ad1640b15 req-fa77ecdf-ae72-4ba3-bd08-f5c7f6109c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e50bdd-3716-421f-b6ca-832ee1f63c42", "name": "network-vif-plugged", "status": "completed", "tag": "252a7740-2a5f-4b94-9778-971825115baf"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:34:32.279257 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-cf48f7be-79d7-429f-8f61-e32ad1640b15 req-fa77ecdf-ae72-4ba3-bd08-f5c7f6109c28 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:32.279715 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-cf48f7be-79d7-429f-8f61-e32ad1640b15 req-fa77ecdf-ae72-4ba3-bd08-f5c7f6109c28 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:32.290851 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-cf48f7be-79d7-429f-8f61-e32ad1640b15 req-fa77ecdf-ae72-4ba3-bd08-f5c7f6109c28 service nova] Creating event network-vif-plugged:252a7740-2a5f-4b94-9778-971825115baf for instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 on hv-cinder-84932 Jul 12 17:34:32.296111 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-cf48f7be-79d7-429f-8f61-e32ad1640b15 req-fa77ecdf-ae72-4ba3-bd08-f5c7f6109c28 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033581 Jul 12 17:34:32.296867 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 431/885] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:34:32.350256 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ce8d3178-3323-4b5f-9eb3-916572d9ea5d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:32.357581 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ce8d3178-3323-4b5f-9eb3-916572d9ea5d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1366 microversion: 2.1 time: 0.152252 Jul 12 17:34:32.358169 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 455/886] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:32 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:33.374627 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5c5a1a29-a6e5-4f27-97bc-6107b7e92c75 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:33.375322 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5c5a1a29-a6e5-4f27-97bc-6107b7e92c75 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:33.381575 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5c5a1a29-a6e5-4f27-97bc-6107b7e92c75 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:33.382049 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5c5a1a29-a6e5-4f27-97bc-6107b7e92c75 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:33.382803 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5c5a1a29-a6e5-4f27-97bc-6107b7e92c75 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:33.383235 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5c5a1a29-a6e5-4f27-97bc-6107b7e92c75 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:33.509030 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5c5a1a29-a6e5-4f27-97bc-6107b7e92c75 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:33.516409 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5c5a1a29-a6e5-4f27-97bc-6107b7e92c75 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1366 microversion: 2.1 time: 0.145885 Jul 12 17:34:33.517177 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 432/887] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:33 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:34.533419 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-907a0e8f-09cd-4e8c-b1d0-d11be3241f79 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:34.534057 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-907a0e8f-09cd-4e8c-b1d0-d11be3241f79 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:34.540876 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-907a0e8f-09cd-4e8c-b1d0-d11be3241f79 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:34.541316 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-907a0e8f-09cd-4e8c-b1d0-d11be3241f79 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:34.542096 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-907a0e8f-09cd-4e8c-b1d0-d11be3241f79 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:34.542523 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-907a0e8f-09cd-4e8c-b1d0-d11be3241f79 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:34.673413 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-907a0e8f-09cd-4e8c-b1d0-d11be3241f79 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:34.681806 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-907a0e8f-09cd-4e8c-b1d0-d11be3241f79 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1366 microversion: 2.1 time: 0.152177 Jul 12 17:34:34.682364 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 456/888] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:34 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:34:35.698577 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-97cbcb25-0c00-41b8-ad4c-c439ac97a4a5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:35.699187 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-97cbcb25-0c00-41b8-ad4c-c439ac97a4a5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:35.705520 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-97cbcb25-0c00-41b8-ad4c-c439ac97a4a5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:35.706000 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-97cbcb25-0c00-41b8-ad4c-c439ac97a4a5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:35.706750 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-97cbcb25-0c00-41b8-ad4c-c439ac97a4a5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:35.707181 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-97cbcb25-0c00-41b8-ad4c-c439ac97a4a5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:35.840092 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-97cbcb25-0c00-41b8-ad4c-c439ac97a4a5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:35.848272 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-97cbcb25-0c00-41b8-ad4c-c439ac97a4a5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1557 microversion: 2.1 time: 0.153471 Jul 12 17:34:35.849085 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 433/889] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:35 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:34:35.865043 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cea3d540-1ebf-45ac-8d81-84c44c8a24c6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:35.865566 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cea3d540-1ebf-45ac-8d81-84c44c8a24c6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:35.871894 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cea3d540-1ebf-45ac-8d81-84c44c8a24c6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:35.872421 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cea3d540-1ebf-45ac-8d81-84c44c8a24c6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:35.873173 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cea3d540-1ebf-45ac-8d81-84c44c8a24c6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:35.873609 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cea3d540-1ebf-45ac-8d81-84c44c8a24c6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:35.952669 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cea3d540-1ebf-45ac-8d81-84c44c8a24c6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092026 Jul 12 17:34:35.953324 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 457/890] 10.222.0.62 () {58 vars in 1274 bytes} [Tue Jul 12 17:34:35 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:34:36.866763 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-9ccf22ca-ae84-46f2-9357-50329755dbeb req-846da81a-6ca2-4596-b96b-8f151fcb62fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e50bdd-3716-421f-b6ca-832ee1f63c42", "tag": "252a7740-2a5f-4b94-9778-971825115baf"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:34:36.875136 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-9ccf22ca-ae84-46f2-9357-50329755dbeb req-846da81a-6ca2-4596-b96b-8f151fcb62fa service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:36.875582 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-9ccf22ca-ae84-46f2-9357-50329755dbeb req-846da81a-6ca2-4596-b96b-8f151fcb62fa service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:36.886354 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-9ccf22ca-ae84-46f2-9357-50329755dbeb req-846da81a-6ca2-4596-b96b-8f151fcb62fa service nova] Creating event network-changed:252a7740-2a5f-4b94-9778-971825115baf for instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 on hv-cinder-84932 Jul 12 17:34:36.891219 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-9ccf22ca-ae84-46f2-9357-50329755dbeb req-846da81a-6ca2-4596-b96b-8f151fcb62fa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028665 Jul 12 17:34:36.891800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 434/891] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:34:59.323157 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:34:59.323965 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=64 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:34:59.328306 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b7c8f6fe-f756-4010-a616-19d4c0224e1c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1188559550", "imageRef": "b19e7830-75c9-4706-bd34-4954ba6b4cc1", "flavorRef": "452", "networks": [{"uuid": "b01fc38d-33fc-45c5-8ac6-f70c9354cbe7"}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:34:59.379378 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-b7c8f6fe-f756-4010-a616-19d4c0224e1c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] validate_networks() for [('b01fc38d-33fc-45c5-8ac6-f70c9354cbe7', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:34:59.721931 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-b7c8f6fe-f756-4010-a616-19d4c0224e1c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:34:59.722360 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-b7c8f6fe-f756-4010-a616-19d4c0224e1c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:34:59.722858 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-b7c8f6fe-f756-4010-a616-19d4c0224e1c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:34:59.723252 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-b7c8f6fe-f756-4010-a616-19d4c0224e1c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:34:59.723662 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-b7c8f6fe-f756-4010-a616-19d4c0224e1c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:34:59.732971 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7c8f6fe-f756-4010-a616-19d4c0224e1c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:59.733425 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7c8f6fe-f756-4010-a616-19d4c0224e1c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:59.734257 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7c8f6fe-f756-4010-a616-19d4c0224e1c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:34:59.734695 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b7c8f6fe-f756-4010-a616-19d4c0224e1c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:34:59.750953 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-b7c8f6fe-f756-4010-a616-19d4c0224e1c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Getting quotas for project a8791892016f411b83948dcc36e4b243. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:34:59.754890 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-b7c8f6fe-f756-4010-a616-19d4c0224e1c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Getting quotas for user 486e09fa46b8483aa1a0e38de1b70958 and project a8791892016f411b83948dcc36e4b243. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:34:59.766051 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b7c8f6fe-f756-4010-a616-19d4c0224e1c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:34:59.768305 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b7c8f6fe-f756-4010-a616-19d4c0224e1c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: cac1d452-9d15-4985-9ca6-09878db8969e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19e7830-75c9-4706-bd34-4954ba6b4cc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:34:59.814584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b7c8f6fe-f756-4010-a616-19d4c0224e1c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493174 Jul 12 17:34:59.815216 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 458/892] 10.222.0.62 () {60 vars in 1146 bytes} [Tue Jul 12 17:34:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:34:59.823240 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=19 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:34:59.823985 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=80 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:34:59.828339 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ce5aa95f-897d-425c-934a-f50b961e4ffc tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:34:59.829154 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ce5aa95f-897d-425c-934a-f50b961e4ffc tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: cac1d452-9d15-4985-9ca6-09878db8969e] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:34:59.887714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ce5aa95f-897d-425c-934a-f50b961e4ffc tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:34:59.894341 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ce5aa95f-897d-425c-934a-f50b961e4ffc tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e" status: 200 len: 1219 microversion: 2.1 time: 0.072728 Jul 12 17:34:59.894905 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 435/893] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:34:59 2022] GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:35:00.911843 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b440f717-503a-4e5b-8d8a-9f8110e10c43 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:00.912392 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b440f717-503a-4e5b-8d8a-9f8110e10c43 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: cac1d452-9d15-4985-9ca6-09878db8969e] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:00.921263 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b440f717-503a-4e5b-8d8a-9f8110e10c43 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:00.921730 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b440f717-503a-4e5b-8d8a-9f8110e10c43 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:00.922503 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b440f717-503a-4e5b-8d8a-9f8110e10c43 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:00.922965 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b440f717-503a-4e5b-8d8a-9f8110e10c43 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:00.985496 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b440f717-503a-4e5b-8d8a-9f8110e10c43 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:00.993520 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b440f717-503a-4e5b-8d8a-9f8110e10c43 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e" status: 200 len: 1271 microversion: 2.1 time: 0.085671 Jul 12 17:35:00.994190 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 459/894] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:35:00 2022] GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:35:02.011152 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-36c79f0b-916c-4cb3-a84e-970a243bb439 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:02.011768 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-36c79f0b-916c-4cb3-a84e-970a243bb439 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: cac1d452-9d15-4985-9ca6-09878db8969e] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:02.018916 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-36c79f0b-916c-4cb3-a84e-970a243bb439 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:02.019355 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-36c79f0b-916c-4cb3-a84e-970a243bb439 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:02.020121 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-36c79f0b-916c-4cb3-a84e-970a243bb439 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:02.020550 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-36c79f0b-916c-4cb3-a84e-970a243bb439 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:02.529946 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-36c79f0b-916c-4cb3-a84e-970a243bb439 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:02.537272 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-36c79f0b-916c-4cb3-a84e-970a243bb439 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e" status: 200 len: 1319 microversion: 2.1 time: 0.530122 Jul 12 17:35:02.537858 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 436/895] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:35:02 2022] GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e => generated 1319 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:35:03.071415 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-aefe1779-c9f4-4646-afbb-7e7553b7dd6a req-2838dd8b-3728-494b-8ee6-a96482474681 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cac1d452-9d15-4985-9ca6-09878db8969e", "tag": "81d557a0-e82f-4305-ae59-2f74edbd8cab"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:35:03.079882 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-aefe1779-c9f4-4646-afbb-7e7553b7dd6a req-2838dd8b-3728-494b-8ee6-a96482474681 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:03.080330 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-aefe1779-c9f4-4646-afbb-7e7553b7dd6a req-2838dd8b-3728-494b-8ee6-a96482474681 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:03.098576 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-aefe1779-c9f4-4646-afbb-7e7553b7dd6a req-2838dd8b-3728-494b-8ee6-a96482474681 service nova] Creating event network-changed:81d557a0-e82f-4305-ae59-2f74edbd8cab for instance cac1d452-9d15-4985-9ca6-09878db8969e on hv-cinder-84932 Jul 12 17:35:03.103809 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-aefe1779-c9f4-4646-afbb-7e7553b7dd6a req-2838dd8b-3728-494b-8ee6-a96482474681 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036169 Jul 12 17:35:03.104393 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 460/896] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:35:03.554418 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-41fa80e4-49e8-4101-9e58-ed3fabae44ca tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:03.554990 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-41fa80e4-49e8-4101-9e58-ed3fabae44ca tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: cac1d452-9d15-4985-9ca6-09878db8969e] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:03.560832 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-41fa80e4-49e8-4101-9e58-ed3fabae44ca tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:03.561277 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-41fa80e4-49e8-4101-9e58-ed3fabae44ca tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:03.562069 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-41fa80e4-49e8-4101-9e58-ed3fabae44ca tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:03.562503 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-41fa80e4-49e8-4101-9e58-ed3fabae44ca tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:03.694830 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-41fa80e4-49e8-4101-9e58-ed3fabae44ca tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:03.702137 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-41fa80e4-49e8-4101-9e58-ed3fabae44ca tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e" status: 200 len: 1319 microversion: 2.1 time: 0.151837 Jul 12 17:35:03.702692 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 437/897] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:35:03 2022] GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:35:04.720221 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3781af58-fdca-4b48-be3f-9566a02816af tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:04.720924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3781af58-fdca-4b48-be3f-9566a02816af tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: cac1d452-9d15-4985-9ca6-09878db8969e] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:04.727782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3781af58-fdca-4b48-be3f-9566a02816af tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:04.728228 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3781af58-fdca-4b48-be3f-9566a02816af tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:04.728985 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3781af58-fdca-4b48-be3f-9566a02816af tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:04.729417 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3781af58-fdca-4b48-be3f-9566a02816af tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:04.857128 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3781af58-fdca-4b48-be3f-9566a02816af tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:04.864530 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3781af58-fdca-4b48-be3f-9566a02816af tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e" status: 200 len: 1319 microversion: 2.1 time: 0.149112 Jul 12 17:35:04.865089 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 461/898] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:35:04 2022] GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:35:05.881505 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d93c5c58-dee5-4458-b51f-4dba8f7c0491 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:05.882148 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d93c5c58-dee5-4458-b51f-4dba8f7c0491 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: cac1d452-9d15-4985-9ca6-09878db8969e] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:05.888632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d93c5c58-dee5-4458-b51f-4dba8f7c0491 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:05.889085 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d93c5c58-dee5-4458-b51f-4dba8f7c0491 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:05.889888 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d93c5c58-dee5-4458-b51f-4dba8f7c0491 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:05.890326 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d93c5c58-dee5-4458-b51f-4dba8f7c0491 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:06.025302 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d93c5c58-dee5-4458-b51f-4dba8f7c0491 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:06.032742 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d93c5c58-dee5-4458-b51f-4dba8f7c0491 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e" status: 200 len: 1319 microversion: 2.1 time: 0.155636 Jul 12 17:35:06.033301 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 438/899] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:35:05 2022] GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:35:07.049296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-47b0c9d1-a586-47f1-af04-ab3fe531b26b tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:07.049956 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-47b0c9d1-a586-47f1-af04-ab3fe531b26b tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: cac1d452-9d15-4985-9ca6-09878db8969e] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:07.056360 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-47b0c9d1-a586-47f1-af04-ab3fe531b26b tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:07.056809 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-47b0c9d1-a586-47f1-af04-ab3fe531b26b tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:07.057564 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-47b0c9d1-a586-47f1-af04-ab3fe531b26b tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:07.058038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-47b0c9d1-a586-47f1-af04-ab3fe531b26b tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:07.188493 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-47b0c9d1-a586-47f1-af04-ab3fe531b26b tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:07.196018 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-47b0c9d1-a586-47f1-af04-ab3fe531b26b tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e" status: 200 len: 1319 microversion: 2.1 time: 0.150579 Jul 12 17:35:07.196593 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 462/900] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:35:07 2022] GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:35:08.211719 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8145b137-8ba1-47e1-815e-de2f464d31b9 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:08.212321 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8145b137-8ba1-47e1-815e-de2f464d31b9 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: cac1d452-9d15-4985-9ca6-09878db8969e] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:08.218864 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8145b137-8ba1-47e1-815e-de2f464d31b9 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:08.220157 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8145b137-8ba1-47e1-815e-de2f464d31b9 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:08.221041 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8145b137-8ba1-47e1-815e-de2f464d31b9 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:08.221531 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8145b137-8ba1-47e1-815e-de2f464d31b9 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:08.346400 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8145b137-8ba1-47e1-815e-de2f464d31b9 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:08.354239 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8145b137-8ba1-47e1-815e-de2f464d31b9 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e" status: 200 len: 1319 microversion: 2.1 time: 0.146389 Jul 12 17:35:08.354803 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 439/901] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:35:08 2022] GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:35:08.630198 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-86e464ad-1178-486d-a5be-7cc6942361f3 req-986812f4-a0f8-4d7d-a70b-b583cd079223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cac1d452-9d15-4985-9ca6-09878db8969e", "name": "network-vif-plugged", "status": "completed", "tag": "81d557a0-e82f-4305-ae59-2f74edbd8cab"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:35:08.639195 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-86e464ad-1178-486d-a5be-7cc6942361f3 req-986812f4-a0f8-4d7d-a70b-b583cd079223 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:08.639659 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-86e464ad-1178-486d-a5be-7cc6942361f3 req-986812f4-a0f8-4d7d-a70b-b583cd079223 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:08.651685 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-86e464ad-1178-486d-a5be-7cc6942361f3 req-986812f4-a0f8-4d7d-a70b-b583cd079223 service nova] Creating event network-vif-plugged:81d557a0-e82f-4305-ae59-2f74edbd8cab for instance cac1d452-9d15-4985-9ca6-09878db8969e on hv-cinder-84932 Jul 12 17:35:08.656530 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-86e464ad-1178-486d-a5be-7cc6942361f3 req-986812f4-a0f8-4d7d-a70b-b583cd079223 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030011 Jul 12 17:35:08.657120 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 463/902] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:35:09.371233 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f5cd6aa5-33ed-4af5-9346-97a13ee9639a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:09.371839 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f5cd6aa5-33ed-4af5-9346-97a13ee9639a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: cac1d452-9d15-4985-9ca6-09878db8969e] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:09.378278 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f5cd6aa5-33ed-4af5-9346-97a13ee9639a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:09.378724 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f5cd6aa5-33ed-4af5-9346-97a13ee9639a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:09.379486 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f5cd6aa5-33ed-4af5-9346-97a13ee9639a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:09.379917 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f5cd6aa5-33ed-4af5-9346-97a13ee9639a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:09.505568 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f5cd6aa5-33ed-4af5-9346-97a13ee9639a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:09.513513 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f5cd6aa5-33ed-4af5-9346-97a13ee9639a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e" status: 200 len: 1319 microversion: 2.1 time: 0.146142 Jul 12 17:35:09.514092 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 440/903] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:35:09 2022] GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:35:10.530484 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f574bbba-eebf-4831-bb20-35d8cd5524f1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:10.531170 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f574bbba-eebf-4831-bb20-35d8cd5524f1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: cac1d452-9d15-4985-9ca6-09878db8969e] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:10.533511 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:35:10.534188 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:35:10.540351 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f574bbba-eebf-4831-bb20-35d8cd5524f1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:10.540802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f574bbba-eebf-4831-bb20-35d8cd5524f1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:10.541548 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f574bbba-eebf-4831-bb20-35d8cd5524f1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:10.542003 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f574bbba-eebf-4831-bb20-35d8cd5524f1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:10.671819 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f574bbba-eebf-4831-bb20-35d8cd5524f1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:10.679997 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f574bbba-eebf-4831-bb20-35d8cd5524f1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e" status: 200 len: 1506 microversion: 2.1 time: 0.153705 Jul 12 17:35:10.680553 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 464/904] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:35:10 2022] GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:35:18.920401 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c2109c78-963b-42c4-954b-4de36f16feda tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:18.920963 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c2109c78-963b-42c4-954b-4de36f16feda tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:18.922928 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:35:18.928625 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c2109c78-963b-42c4-954b-4de36f16feda tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:18.929067 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c2109c78-963b-42c4-954b-4de36f16feda tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:18.929888 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c2109c78-963b-42c4-954b-4de36f16feda tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:18.930318 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c2109c78-963b-42c4-954b-4de36f16feda tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:18.953721 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c2109c78-963b-42c4-954b-4de36f16feda tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6/ips" status: 200 len: 152 microversion: 2.20 time: 0.037205 Jul 12 17:35:18.954210 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 441/905] 10.222.0.62 () {60 vars in 1288 bytes} [Tue Jul 12 17:35:18 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:35:21.779023 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-26b65447-896e-4c8c-ab01-efe7d9880650 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:35:21.779565 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-26b65447-896e-4c8c-ab01-efe7d9880650 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:21.781954 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:35:21.782705 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=30 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:35:21.789364 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-26b65447-896e-4c8c-ab01-efe7d9880650 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:21.789844 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-26b65447-896e-4c8c-ab01-efe7d9880650 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:21.790612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-26b65447-896e-4c8c-ab01-efe7d9880650 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:21.791057 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-26b65447-896e-4c8c-ab01-efe7d9880650 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:21.813198 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-26b65447-896e-4c8c-ab01-efe7d9880650 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lazy-loading 'flavor' on Instance uuid aeedc087-222c-4452-bf37-2f152ce787a6 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:35:22.064996 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-26b65447-896e-4c8c-ab01-efe7d9880650 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "POST /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6/action" status: 202 len: 0 microversion: 2.20 time: 0.290415 Jul 12 17:35:22.065607 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 465/906] 10.222.0.62 () {62 vars in 1318 bytes} [Tue Jul 12 17:35:21 2022] POST /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:35:22.074856 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4de0a217-8f3f-4dee-9d26-5557bcc1b527 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:22.075473 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4de0a217-8f3f-4dee-9d26-5557bcc1b527 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:22.082012 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4de0a217-8f3f-4dee-9d26-5557bcc1b527 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:22.082467 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4de0a217-8f3f-4dee-9d26-5557bcc1b527 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:22.083273 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4de0a217-8f3f-4dee-9d26-5557bcc1b527 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:22.083758 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4de0a217-8f3f-4dee-9d26-5557bcc1b527 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:22.211770 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4de0a217-8f3f-4dee-9d26-5557bcc1b527 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:22.219618 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4de0a217-8f3f-4dee-9d26-5557bcc1b527 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:22.221135 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4de0a217-8f3f-4dee-9d26-5557bcc1b527 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:22.222327 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4de0a217-8f3f-4dee-9d26-5557bcc1b527 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1723 microversion: 2.20 time: 0.152264 Jul 12 17:35:22.222876 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 442/907] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:22 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:23.242830 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d70782a9-deb5-46af-a7a5-d414ac82a6a8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:23.243530 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d70782a9-deb5-46af-a7a5-d414ac82a6a8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:23.249843 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d70782a9-deb5-46af-a7a5-d414ac82a6a8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:23.250293 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d70782a9-deb5-46af-a7a5-d414ac82a6a8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:23.251080 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d70782a9-deb5-46af-a7a5-d414ac82a6a8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:23.251519 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d70782a9-deb5-46af-a7a5-d414ac82a6a8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:23.379627 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d70782a9-deb5-46af-a7a5-d414ac82a6a8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:23.388043 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d70782a9-deb5-46af-a7a5-d414ac82a6a8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:23.389549 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d70782a9-deb5-46af-a7a5-d414ac82a6a8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:23.390731 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d70782a9-deb5-46af-a7a5-d414ac82a6a8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1723 microversion: 2.20 time: 0.152808 Jul 12 17:35:23.391283 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 466/908] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:23 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:24.409161 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b66dd80a-9f17-445a-a968-3f0dcf8ae336 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:24.409800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b66dd80a-9f17-445a-a968-3f0dcf8ae336 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:24.416434 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b66dd80a-9f17-445a-a968-3f0dcf8ae336 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:24.417470 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b66dd80a-9f17-445a-a968-3f0dcf8ae336 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:24.418271 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b66dd80a-9f17-445a-a968-3f0dcf8ae336 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:24.418721 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b66dd80a-9f17-445a-a968-3f0dcf8ae336 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:24.544520 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b66dd80a-9f17-445a-a968-3f0dcf8ae336 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:24.552301 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b66dd80a-9f17-445a-a968-3f0dcf8ae336 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:24.553856 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b66dd80a-9f17-445a-a968-3f0dcf8ae336 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:24.555015 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b66dd80a-9f17-445a-a968-3f0dcf8ae336 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1723 microversion: 2.20 time: 0.149832 Jul 12 17:35:24.555559 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 443/909] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:24 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:25.572568 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f2f2fd00-6c2a-461f-93ab-099242711233 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:25.573165 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f2f2fd00-6c2a-461f-93ab-099242711233 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:25.579627 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f2f2fd00-6c2a-461f-93ab-099242711233 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:25.580076 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f2f2fd00-6c2a-461f-93ab-099242711233 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:25.580834 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f2f2fd00-6c2a-461f-93ab-099242711233 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:25.581268 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f2f2fd00-6c2a-461f-93ab-099242711233 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:25.706790 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f2f2fd00-6c2a-461f-93ab-099242711233 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:25.715146 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f2f2fd00-6c2a-461f-93ab-099242711233 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:25.716653 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f2f2fd00-6c2a-461f-93ab-099242711233 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:25.717927 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f2f2fd00-6c2a-461f-93ab-099242711233 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1723 microversion: 2.20 time: 0.149132 Jul 12 17:35:25.718490 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 467/910] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:25 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:26.736098 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7f218fad-5c27-4178-9fd3-f9c0b6bde576 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:26.736719 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7f218fad-5c27-4178-9fd3-f9c0b6bde576 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:26.743662 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f218fad-5c27-4178-9fd3-f9c0b6bde576 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:26.744210 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f218fad-5c27-4178-9fd3-f9c0b6bde576 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:26.745765 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f218fad-5c27-4178-9fd3-f9c0b6bde576 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:26.746221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f218fad-5c27-4178-9fd3-f9c0b6bde576 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:26.879539 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7f218fad-5c27-4178-9fd3-f9c0b6bde576 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:26.887972 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7f218fad-5c27-4178-9fd3-f9c0b6bde576 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:26.889491 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7f218fad-5c27-4178-9fd3-f9c0b6bde576 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:26.890680 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7f218fad-5c27-4178-9fd3-f9c0b6bde576 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1723 microversion: 2.20 time: 0.158543 Jul 12 17:35:26.891240 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 444/911] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:26 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:27.908148 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-19da0620-9331-4c5a-8c1f-d7d8b9a6198b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:27.908758 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-19da0620-9331-4c5a-8c1f-d7d8b9a6198b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:27.915248 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-19da0620-9331-4c5a-8c1f-d7d8b9a6198b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:27.915697 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-19da0620-9331-4c5a-8c1f-d7d8b9a6198b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:27.916461 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-19da0620-9331-4c5a-8c1f-d7d8b9a6198b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:27.917510 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-19da0620-9331-4c5a-8c1f-d7d8b9a6198b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:28.042969 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-19da0620-9331-4c5a-8c1f-d7d8b9a6198b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:28.050879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-19da0620-9331-4c5a-8c1f-d7d8b9a6198b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:28.052399 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-19da0620-9331-4c5a-8c1f-d7d8b9a6198b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:28.053553 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-19da0620-9331-4c5a-8c1f-d7d8b9a6198b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1723 microversion: 2.20 time: 0.149247 Jul 12 17:35:28.054218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 468/912] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:27 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:29.071897 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c2e99018-3716-496f-bc06-cbf4557ab45c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:29.072543 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c2e99018-3716-496f-bc06-cbf4557ab45c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:29.079125 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c2e99018-3716-496f-bc06-cbf4557ab45c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:29.079576 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c2e99018-3716-496f-bc06-cbf4557ab45c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:29.080337 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c2e99018-3716-496f-bc06-cbf4557ab45c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:29.080773 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c2e99018-3716-496f-bc06-cbf4557ab45c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:29.209477 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c2e99018-3716-496f-bc06-cbf4557ab45c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:29.217261 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c2e99018-3716-496f-bc06-cbf4557ab45c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:29.218803 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c2e99018-3716-496f-bc06-cbf4557ab45c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:29.219995 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c2e99018-3716-496f-bc06-cbf4557ab45c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1723 microversion: 2.20 time: 0.152040 Jul 12 17:35:29.220554 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 445/913] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:29 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:30.238527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e1875328-c5c7-49b5-a24f-2fe25d557f77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:30.239261 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e1875328-c5c7-49b5-a24f-2fe25d557f77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:30.246174 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1875328-c5c7-49b5-a24f-2fe25d557f77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:30.246621 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1875328-c5c7-49b5-a24f-2fe25d557f77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:30.247420 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1875328-c5c7-49b5-a24f-2fe25d557f77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:30.247852 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e1875328-c5c7-49b5-a24f-2fe25d557f77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:30.373544 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e1875328-c5c7-49b5-a24f-2fe25d557f77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:30.381319 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e1875328-c5c7-49b5-a24f-2fe25d557f77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:30.382856 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e1875328-c5c7-49b5-a24f-2fe25d557f77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:30.384002 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e1875328-c5c7-49b5-a24f-2fe25d557f77 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1723 microversion: 2.20 time: 0.149419 Jul 12 17:35:30.384558 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 469/914] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:30 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:31.403266 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2182910a-ac7e-44e1-96fa-34583ccda387 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:31.403873 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2182910a-ac7e-44e1-96fa-34583ccda387 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:31.406115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=25 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:35:31.411300 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2182910a-ac7e-44e1-96fa-34583ccda387 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:31.411746 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2182910a-ac7e-44e1-96fa-34583ccda387 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:31.412497 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2182910a-ac7e-44e1-96fa-34583ccda387 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:31.412926 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2182910a-ac7e-44e1-96fa-34583ccda387 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:31.415584 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=59 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:35:31.537824 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2182910a-ac7e-44e1-96fa-34583ccda387 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:31.545571 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2182910a-ac7e-44e1-96fa-34583ccda387 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:31.547141 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2182910a-ac7e-44e1-96fa-34583ccda387 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:31.548289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2182910a-ac7e-44e1-96fa-34583ccda387 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1723 microversion: 2.20 time: 0.149700 Jul 12 17:35:31.548844 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 446/915] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:31 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:32.566580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4287f72b-4615-4c1e-971b-b5eaa17adb5d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:32.567184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4287f72b-4615-4c1e-971b-b5eaa17adb5d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:32.573891 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4287f72b-4615-4c1e-971b-b5eaa17adb5d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:32.574374 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4287f72b-4615-4c1e-971b-b5eaa17adb5d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:32.575123 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4287f72b-4615-4c1e-971b-b5eaa17adb5d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:32.575552 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4287f72b-4615-4c1e-971b-b5eaa17adb5d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:32.704195 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4287f72b-4615-4c1e-971b-b5eaa17adb5d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:32.711907 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4287f72b-4615-4c1e-971b-b5eaa17adb5d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:32.713945 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4287f72b-4615-4c1e-971b-b5eaa17adb5d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:32.715091 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4287f72b-4615-4c1e-971b-b5eaa17adb5d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1723 microversion: 2.20 time: 0.152698 Jul 12 17:35:32.715641 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 470/916] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:32 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:33.733101 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-af4a1f49-5e4d-4441-8631-05c9608aa460 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:33.733743 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-af4a1f49-5e4d-4441-8631-05c9608aa460 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:33.739776 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-af4a1f49-5e4d-4441-8631-05c9608aa460 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:33.740219 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-af4a1f49-5e4d-4441-8631-05c9608aa460 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:33.740970 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-af4a1f49-5e4d-4441-8631-05c9608aa460 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:33.741397 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-af4a1f49-5e4d-4441-8631-05c9608aa460 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:33.866623 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-af4a1f49-5e4d-4441-8631-05c9608aa460 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:33.874911 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-af4a1f49-5e4d-4441-8631-05c9608aa460 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:33.876413 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-af4a1f49-5e4d-4441-8631-05c9608aa460 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:33.877557 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-af4a1f49-5e4d-4441-8631-05c9608aa460 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1723 microversion: 2.20 time: 0.148658 Jul 12 17:35:33.878138 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 447/917] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:33 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:34.134200 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b3449f39-17de-4ca3-a828-714a8e6bf5d7 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4083d101-cf14-4ab4-b309-b4e1240ba1ca", "device": "/dev/sdb"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:35:34.136474 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b3449f39-17de-4ca3-a828-714a8e6bf5d7 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: cac1d452-9d15-4985-9ca6-09878db8969e] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:34.143036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b3449f39-17de-4ca3-a828-714a8e6bf5d7 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:34.143478 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b3449f39-17de-4ca3-a828-714a8e6bf5d7 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:34.144350 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b3449f39-17de-4ca3-a828-714a8e6bf5d7 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:34.144822 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b3449f39-17de-4ca3-a828-714a8e6bf5d7 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:34.390989 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b3449f39-17de-4ca3-a828-714a8e6bf5d7 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "POST /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260707 Jul 12 17:35:34.391838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 471/918] 10.222.0.62 () {60 vars in 1322 bytes} [Tue Jul 12 17:35:34 2022] POST /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:35:34.895420 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-afd21814-a7f4-459f-b9dc-cfb64d850d71 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:34.895974 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-afd21814-a7f4-459f-b9dc-cfb64d850d71 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:34.902930 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-afd21814-a7f4-459f-b9dc-cfb64d850d71 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:34.903379 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-afd21814-a7f4-459f-b9dc-cfb64d850d71 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:34.904136 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-afd21814-a7f4-459f-b9dc-cfb64d850d71 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:34.904567 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-afd21814-a7f4-459f-b9dc-cfb64d850d71 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:35.038322 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-afd21814-a7f4-459f-b9dc-cfb64d850d71 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:35.046168 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-afd21814-a7f4-459f-b9dc-cfb64d850d71 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:35.047678 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-afd21814-a7f4-459f-b9dc-cfb64d850d71 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:35.048827 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-afd21814-a7f4-459f-b9dc-cfb64d850d71 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1723 microversion: 2.20 time: 0.157466 Jul 12 17:35:35.049383 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 448/919] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:34 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:36.068858 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bbbc4634-c26f-4ed1-b2e4-360e8bde9886 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:36.069561 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bbbc4634-c26f-4ed1-b2e4-360e8bde9886 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:36.076274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bbbc4634-c26f-4ed1-b2e4-360e8bde9886 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:36.076962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bbbc4634-c26f-4ed1-b2e4-360e8bde9886 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:36.077764 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bbbc4634-c26f-4ed1-b2e4-360e8bde9886 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:36.078207 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bbbc4634-c26f-4ed1-b2e4-360e8bde9886 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:36.205112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bbbc4634-c26f-4ed1-b2e4-360e8bde9886 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:36.212953 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bbbc4634-c26f-4ed1-b2e4-360e8bde9886 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:36.215015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bbbc4634-c26f-4ed1-b2e4-360e8bde9886 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:36.216159 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bbbc4634-c26f-4ed1-b2e4-360e8bde9886 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1723 microversion: 2.20 time: 0.151886 Jul 12 17:35:36.216708 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 472/920] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:36 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:37.234703 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-504f77bf-7afe-4da1-835e-fdd2135d44bf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:37.235315 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-504f77bf-7afe-4da1-835e-fdd2135d44bf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:37.241843 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-504f77bf-7afe-4da1-835e-fdd2135d44bf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:37.242294 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-504f77bf-7afe-4da1-835e-fdd2135d44bf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:37.243060 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-504f77bf-7afe-4da1-835e-fdd2135d44bf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:37.243497 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-504f77bf-7afe-4da1-835e-fdd2135d44bf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:37.372483 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-504f77bf-7afe-4da1-835e-fdd2135d44bf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:37.380232 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-504f77bf-7afe-4da1-835e-fdd2135d44bf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:37.381771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-504f77bf-7afe-4da1-835e-fdd2135d44bf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:37.382934 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-504f77bf-7afe-4da1-835e-fdd2135d44bf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1723 microversion: 2.20 time: 0.152200 Jul 12 17:35:37.383488 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 449/921] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:37 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:38.400393 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b3ce8cf1-66fe-482c-9175-f5cbf8dd0167 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:38.401016 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b3ce8cf1-66fe-482c-9175-f5cbf8dd0167 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:38.407364 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b3ce8cf1-66fe-482c-9175-f5cbf8dd0167 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:38.407812 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b3ce8cf1-66fe-482c-9175-f5cbf8dd0167 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:38.408569 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b3ce8cf1-66fe-482c-9175-f5cbf8dd0167 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:38.409011 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b3ce8cf1-66fe-482c-9175-f5cbf8dd0167 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:38.534061 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b3ce8cf1-66fe-482c-9175-f5cbf8dd0167 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:38.541981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b3ce8cf1-66fe-482c-9175-f5cbf8dd0167 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:38.543500 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b3ce8cf1-66fe-482c-9175-f5cbf8dd0167 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:38.544648 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b3ce8cf1-66fe-482c-9175-f5cbf8dd0167 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1723 microversion: 2.20 time: 0.148270 Jul 12 17:35:38.545206 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 473/922] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:38 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:39.563824 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4adb180c-ecc3-41b9-8df5-f65717c47425 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:39.564428 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4adb180c-ecc3-41b9-8df5-f65717c47425 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:39.571256 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4adb180c-ecc3-41b9-8df5-f65717c47425 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:39.571712 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4adb180c-ecc3-41b9-8df5-f65717c47425 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:39.572489 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4adb180c-ecc3-41b9-8df5-f65717c47425 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:39.572931 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4adb180c-ecc3-41b9-8df5-f65717c47425 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:39.699634 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4adb180c-ecc3-41b9-8df5-f65717c47425 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:39.707421 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4adb180c-ecc3-41b9-8df5-f65717c47425 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:39.708952 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4adb180c-ecc3-41b9-8df5-f65717c47425 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:39.710149 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4adb180c-ecc3-41b9-8df5-f65717c47425 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1744 microversion: 2.20 time: 0.150298 Jul 12 17:35:39.710753 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 450/923] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:39 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:40.728296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8c8f5ae1-3adf-4f0e-ace5-4ca9517d3174 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:40.729016 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8c8f5ae1-3adf-4f0e-ace5-4ca9517d3174 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:40.735899 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c8f5ae1-3adf-4f0e-ace5-4ca9517d3174 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:40.736360 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c8f5ae1-3adf-4f0e-ace5-4ca9517d3174 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:40.737122 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c8f5ae1-3adf-4f0e-ace5-4ca9517d3174 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:40.737554 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8c8f5ae1-3adf-4f0e-ace5-4ca9517d3174 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:40.873918 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8c8f5ae1-3adf-4f0e-ace5-4ca9517d3174 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:40.881808 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8c8f5ae1-3adf-4f0e-ace5-4ca9517d3174 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:40.883456 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8c8f5ae1-3adf-4f0e-ace5-4ca9517d3174 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:40.884610 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8c8f5ae1-3adf-4f0e-ace5-4ca9517d3174 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1744 microversion: 2.20 time: 0.160326 Jul 12 17:35:40.885164 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 474/924] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:40 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:41.902565 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8a59e482-418c-4f46-a599-209d6bdfcc79 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:41.903292 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8a59e482-418c-4f46-a599-209d6bdfcc79 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:41.909813 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8a59e482-418c-4f46-a599-209d6bdfcc79 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:41.910401 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8a59e482-418c-4f46-a599-209d6bdfcc79 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:41.911103 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8a59e482-418c-4f46-a599-209d6bdfcc79 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:41.911495 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8a59e482-418c-4f46-a599-209d6bdfcc79 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:42.061191 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8a59e482-418c-4f46-a599-209d6bdfcc79 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:42.069363 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8a59e482-418c-4f46-a599-209d6bdfcc79 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:42.070900 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8a59e482-418c-4f46-a599-209d6bdfcc79 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:42.072055 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8a59e482-418c-4f46-a599-209d6bdfcc79 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1744 microversion: 2.20 time: 0.173342 Jul 12 17:35:42.072646 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 451/925] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:41 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:42.825655 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-5affb9d3-5477-454f-8e18-22e4ecf45eee req-9dad7fd2-785d-42db-9151-732b896627e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeedc087-222c-4452-bf37-2f152ce787a6", "name": "network-vif-plugged", "status": "completed", "tag": "c8a34f14-81f6-401c-83f7-ce051f443de8"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:35:42.834934 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-5affb9d3-5477-454f-8e18-22e4ecf45eee req-9dad7fd2-785d-42db-9151-732b896627e1 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:42.835476 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-5affb9d3-5477-454f-8e18-22e4ecf45eee req-9dad7fd2-785d-42db-9151-732b896627e1 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:42.847397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-5affb9d3-5477-454f-8e18-22e4ecf45eee req-9dad7fd2-785d-42db-9151-732b896627e1 service nova] Creating event network-vif-plugged:c8a34f14-81f6-401c-83f7-ce051f443de8 for instance aeedc087-222c-4452-bf37-2f152ce787a6 on hv-cinder-84932 Jul 12 17:35:42.852385 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-5affb9d3-5477-454f-8e18-22e4ecf45eee req-9dad7fd2-785d-42db-9151-732b896627e1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031021 Jul 12 17:35:42.852969 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 475/926] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:35:43.090772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1cdec5c2-c93a-4f22-b806-b77c67a24852 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:43.091383 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1cdec5c2-c93a-4f22-b806-b77c67a24852 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:43.097756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1cdec5c2-c93a-4f22-b806-b77c67a24852 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:43.098236 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1cdec5c2-c93a-4f22-b806-b77c67a24852 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:43.099000 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1cdec5c2-c93a-4f22-b806-b77c67a24852 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:43.099437 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1cdec5c2-c93a-4f22-b806-b77c67a24852 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:43.227540 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1cdec5c2-c93a-4f22-b806-b77c67a24852 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:43.235806 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1cdec5c2-c93a-4f22-b806-b77c67a24852 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:43.237317 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1cdec5c2-c93a-4f22-b806-b77c67a24852 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:43.238525 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1cdec5c2-c93a-4f22-b806-b77c67a24852 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1744 microversion: 2.20 time: 0.151767 Jul 12 17:35:43.239087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 452/927] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:43 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:44.256772 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9a5f733d-a637-4d65-984c-8bf568550189 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:44.257468 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9a5f733d-a637-4d65-984c-8bf568550189 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:44.264643 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9a5f733d-a637-4d65-984c-8bf568550189 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:44.265095 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9a5f733d-a637-4d65-984c-8bf568550189 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:44.265891 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9a5f733d-a637-4d65-984c-8bf568550189 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:44.266330 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9a5f733d-a637-4d65-984c-8bf568550189 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:44.392771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9a5f733d-a637-4d65-984c-8bf568550189 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:44.400540 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9a5f733d-a637-4d65-984c-8bf568550189 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:44.402067 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9a5f733d-a637-4d65-984c-8bf568550189 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:44.403204 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9a5f733d-a637-4d65-984c-8bf568550189 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1744 microversion: 2.20 time: 0.150694 Jul 12 17:35:44.403757 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 476/928] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:44 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:45.420844 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ae7c8ceb-d893-4f8d-bbe1-f212d96bb5fc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:45.421380 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ae7c8ceb-d893-4f8d-bbe1-f212d96bb5fc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:45.427873 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ae7c8ceb-d893-4f8d-bbe1-f212d96bb5fc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:45.428324 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ae7c8ceb-d893-4f8d-bbe1-f212d96bb5fc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:45.429088 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ae7c8ceb-d893-4f8d-bbe1-f212d96bb5fc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:45.429530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ae7c8ceb-d893-4f8d-bbe1-f212d96bb5fc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:45.555892 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ae7c8ceb-d893-4f8d-bbe1-f212d96bb5fc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:45.563669 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ae7c8ceb-d893-4f8d-bbe1-f212d96bb5fc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:45.565190 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ae7c8ceb-d893-4f8d-bbe1-f212d96bb5fc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:45.566628 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ae7c8ceb-d893-4f8d-bbe1-f212d96bb5fc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1744 microversion: 2.20 time: 0.150318 Jul 12 17:35:45.567175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 453/929] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:45 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:46.584973 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-87f837d6-d61c-4d99-865f-50c7257334c3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:46.585578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-87f837d6-d61c-4d99-865f-50c7257334c3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:46.592522 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-87f837d6-d61c-4d99-865f-50c7257334c3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:46.592967 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-87f837d6-d61c-4d99-865f-50c7257334c3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:46.593742 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-87f837d6-d61c-4d99-865f-50c7257334c3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:46.594173 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-87f837d6-d61c-4d99-865f-50c7257334c3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:46.724655 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-87f837d6-d61c-4d99-865f-50c7257334c3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:46.733064 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-87f837d6-d61c-4d99-865f-50c7257334c3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:46.734608 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-87f837d6-d61c-4d99-865f-50c7257334c3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:46.735766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-87f837d6-d61c-4d99-865f-50c7257334c3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1744 microversion: 2.20 time: 0.154689 Jul 12 17:35:46.736320 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 477/930] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:46 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:47.753957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b6f0d3ab-4ea8-4a66-baf8-a9e1daba8890 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:47.754569 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b6f0d3ab-4ea8-4a66-baf8-a9e1daba8890 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:47.761101 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b6f0d3ab-4ea8-4a66-baf8-a9e1daba8890 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:47.761550 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b6f0d3ab-4ea8-4a66-baf8-a9e1daba8890 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:47.762343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b6f0d3ab-4ea8-4a66-baf8-a9e1daba8890 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:47.762811 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b6f0d3ab-4ea8-4a66-baf8-a9e1daba8890 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:47.890576 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b6f0d3ab-4ea8-4a66-baf8-a9e1daba8890 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:47.898395 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b6f0d3ab-4ea8-4a66-baf8-a9e1daba8890 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:47.899910 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b6f0d3ab-4ea8-4a66-baf8-a9e1daba8890 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:47.901071 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b6f0d3ab-4ea8-4a66-baf8-a9e1daba8890 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1744 microversion: 2.20 time: 0.151142 Jul 12 17:35:47.901619 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 454/931] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:47 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:48.919075 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-387304e0-446c-4418-9bd2-497d12ee531d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:48.919682 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-387304e0-446c-4418-9bd2-497d12ee531d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:48.926085 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-387304e0-446c-4418-9bd2-497d12ee531d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:48.926525 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-387304e0-446c-4418-9bd2-497d12ee531d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:48.927274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-387304e0-446c-4418-9bd2-497d12ee531d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:48.927703 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-387304e0-446c-4418-9bd2-497d12ee531d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:49.058319 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-387304e0-446c-4418-9bd2-497d12ee531d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:49.061775 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:35:49.067303 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-387304e0-446c-4418-9bd2-497d12ee531d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:49.068796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-387304e0-446c-4418-9bd2-497d12ee531d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:49.069968 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-387304e0-446c-4418-9bd2-497d12ee531d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1744 microversion: 2.20 time: 0.154749 Jul 12 17:35:49.070523 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 478/932] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:48 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:50.089356 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f2c98f4b-4714-4228-b3f5-7c52827465dc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:50.090052 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f2c98f4b-4714-4228-b3f5-7c52827465dc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:50.096732 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f2c98f4b-4714-4228-b3f5-7c52827465dc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:50.097215 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f2c98f4b-4714-4228-b3f5-7c52827465dc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:50.098011 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f2c98f4b-4714-4228-b3f5-7c52827465dc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:50.098448 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f2c98f4b-4714-4228-b3f5-7c52827465dc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:50.225353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f2c98f4b-4714-4228-b3f5-7c52827465dc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:50.233382 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f2c98f4b-4714-4228-b3f5-7c52827465dc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:50.234911 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f2c98f4b-4714-4228-b3f5-7c52827465dc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:50.236059 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f2c98f4b-4714-4228-b3f5-7c52827465dc tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1744 microversion: 2.20 time: 0.151289 Jul 12 17:35:50.236608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 455/933] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:50 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:51.254148 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-82289071-1524-4bed-b0df-ec6b6e169f17 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:51.254754 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-82289071-1524-4bed-b0df-ec6b6e169f17 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:51.262251 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-82289071-1524-4bed-b0df-ec6b6e169f17 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:51.262698 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-82289071-1524-4bed-b0df-ec6b6e169f17 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:51.263463 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-82289071-1524-4bed-b0df-ec6b6e169f17 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:51.263922 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-82289071-1524-4bed-b0df-ec6b6e169f17 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:51.527714 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-82289071-1524-4bed-b0df-ec6b6e169f17 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:51.535525 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-82289071-1524-4bed-b0df-ec6b6e169f17 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:51.537050 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-82289071-1524-4bed-b0df-ec6b6e169f17 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:51.538222 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-82289071-1524-4bed-b0df-ec6b6e169f17 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1744 microversion: 2.20 time: 0.288010 Jul 12 17:35:51.538787 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 479/934] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:51 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1744 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:52.556179 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8251717c-f4ad-4532-9cf9-7aa5d96b3904 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:52.556795 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8251717c-f4ad-4532-9cf9-7aa5d96b3904 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:52.564079 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8251717c-f4ad-4532-9cf9-7aa5d96b3904 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:52.564531 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8251717c-f4ad-4532-9cf9-7aa5d96b3904 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:52.565293 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8251717c-f4ad-4532-9cf9-7aa5d96b3904 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:52.566025 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8251717c-f4ad-4532-9cf9-7aa5d96b3904 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:52.742126 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8251717c-f4ad-4532-9cf9-7aa5d96b3904 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:52.750010 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8251717c-f4ad-4532-9cf9-7aa5d96b3904 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:52.751605 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8251717c-f4ad-4532-9cf9-7aa5d96b3904 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:52.752778 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8251717c-f4ad-4532-9cf9-7aa5d96b3904 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1744 microversion: 2.20 time: 0.200518 Jul 12 17:35:52.753334 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 456/935] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:52 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1744 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:53.772337 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-18651bb4-4115-43cf-b342-b2b07f60590f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:53.772974 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-18651bb4-4115-43cf-b342-b2b07f60590f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:53.775342 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=31 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:35:53.780531 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-18651bb4-4115-43cf-b342-b2b07f60590f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:53.780968 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-18651bb4-4115-43cf-b342-b2b07f60590f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:53.781744 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-18651bb4-4115-43cf-b342-b2b07f60590f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:53.782178 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-18651bb4-4115-43cf-b342-b2b07f60590f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:53.907886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-18651bb4-4115-43cf-b342-b2b07f60590f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:53.915701 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-18651bb4-4115-43cf-b342-b2b07f60590f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:53.917720 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-18651bb4-4115-43cf-b342-b2b07f60590f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:53.918873 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-18651bb4-4115-43cf-b342-b2b07f60590f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1744 microversion: 2.20 time: 0.150498 Jul 12 17:35:53.919430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 480/936] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:53 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:54.937488 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-16afe2cb-3d76-4a7c-98d1-78f8d43b326c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:54.939084 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-16afe2cb-3d76-4a7c-98d1-78f8d43b326c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:54.947816 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-16afe2cb-3d76-4a7c-98d1-78f8d43b326c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:54.949182 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-16afe2cb-3d76-4a7c-98d1-78f8d43b326c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:54.950159 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-16afe2cb-3d76-4a7c-98d1-78f8d43b326c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:54.950663 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-16afe2cb-3d76-4a7c-98d1-78f8d43b326c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:55.103276 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-16afe2cb-3d76-4a7c-98d1-78f8d43b326c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:55.111972 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-16afe2cb-3d76-4a7c-98d1-78f8d43b326c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:55.113491 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-16afe2cb-3d76-4a7c-98d1-78f8d43b326c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:55.114681 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-16afe2cb-3d76-4a7c-98d1-78f8d43b326c tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1739 microversion: 2.20 time: 0.181308 Jul 12 17:35:55.115260 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 457/937] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:54 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:35:56.134246 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-853b8a62-52d1-4be9-b054-940d4fd04c1e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:56.136401 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-853b8a62-52d1-4be9-b054-940d4fd04c1e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:56.143708 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-853b8a62-52d1-4be9-b054-940d4fd04c1e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:56.144358 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-853b8a62-52d1-4be9-b054-940d4fd04c1e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:56.145353 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-853b8a62-52d1-4be9-b054-940d4fd04c1e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:56.145836 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-853b8a62-52d1-4be9-b054-940d4fd04c1e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:56.287317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-853b8a62-52d1-4be9-b054-940d4fd04c1e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:56.297789 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-853b8a62-52d1-4be9-b054-940d4fd04c1e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:56.299408 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-853b8a62-52d1-4be9-b054-940d4fd04c1e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:56.300569 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-853b8a62-52d1-4be9-b054-940d4fd04c1e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1739 microversion: 2.20 time: 0.170754 Jul 12 17:35:56.301127 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 481/938] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:56 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:57.319928 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-eedabfde-1aff-4e79-b4bb-22f135de148a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:57.320696 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-eedabfde-1aff-4e79-b4bb-22f135de148a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:57.328533 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eedabfde-1aff-4e79-b4bb-22f135de148a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:57.328989 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eedabfde-1aff-4e79-b4bb-22f135de148a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:57.330428 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eedabfde-1aff-4e79-b4bb-22f135de148a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:57.331166 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eedabfde-1aff-4e79-b4bb-22f135de148a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:57.485592 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-eedabfde-1aff-4e79-b4bb-22f135de148a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:57.494209 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-eedabfde-1aff-4e79-b4bb-22f135de148a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:57.495785 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-eedabfde-1aff-4e79-b4bb-22f135de148a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:57.496974 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-eedabfde-1aff-4e79-b4bb-22f135de148a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1739 microversion: 2.20 time: 0.181295 Jul 12 17:35:57.497538 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 458/939] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:57 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:58.515668 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8416d515-180d-48ea-955f-6083b3db7437 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:58.516271 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8416d515-180d-48ea-955f-6083b3db7437 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:58.523088 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8416d515-180d-48ea-955f-6083b3db7437 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:58.523532 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8416d515-180d-48ea-955f-6083b3db7437 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:58.524286 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8416d515-180d-48ea-955f-6083b3db7437 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:58.524731 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8416d515-180d-48ea-955f-6083b3db7437 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:58.659152 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8416d515-180d-48ea-955f-6083b3db7437 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:58.667820 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8416d515-180d-48ea-955f-6083b3db7437 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:58.669320 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8416d515-180d-48ea-955f-6083b3db7437 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:58.670533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8416d515-180d-48ea-955f-6083b3db7437 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1739 microversion: 2.20 time: 0.158746 Jul 12 17:35:58.676755 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 482/940] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:58 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:35:59.688294 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-92bc1c6b-7ce1-403b-957d-4da4dc51e097 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:35:59.689064 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-92bc1c6b-7ce1-403b-957d-4da4dc51e097 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:35:59.695602 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-92bc1c6b-7ce1-403b-957d-4da4dc51e097 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:59.696128 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-92bc1c6b-7ce1-403b-957d-4da4dc51e097 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:59.696965 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-92bc1c6b-7ce1-403b-957d-4da4dc51e097 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:35:59.697398 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-92bc1c6b-7ce1-403b-957d-4da4dc51e097 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:35:59.836289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-92bc1c6b-7ce1-403b-957d-4da4dc51e097 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:59.845178 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-92bc1c6b-7ce1-403b-957d-4da4dc51e097 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:59.846917 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-92bc1c6b-7ce1-403b-957d-4da4dc51e097 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:35:59.848186 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-92bc1c6b-7ce1-403b-957d-4da4dc51e097 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1739 microversion: 2.20 time: 0.163821 Jul 12 17:35:59.849720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 459/941] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:35:59 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:00.866418 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f8d848ef-586c-4c6c-89d2-024c28e28bab tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:00.867064 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f8d848ef-586c-4c6c-89d2-024c28e28bab tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:00.877153 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f8d848ef-586c-4c6c-89d2-024c28e28bab tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:00.877993 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f8d848ef-586c-4c6c-89d2-024c28e28bab tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:00.880340 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f8d848ef-586c-4c6c-89d2-024c28e28bab tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:00.880340 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f8d848ef-586c-4c6c-89d2-024c28e28bab tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:01.055079 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f8d848ef-586c-4c6c-89d2-024c28e28bab tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:01.063569 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f8d848ef-586c-4c6c-89d2-024c28e28bab tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:01.065070 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f8d848ef-586c-4c6c-89d2-024c28e28bab tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:01.066632 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f8d848ef-586c-4c6c-89d2-024c28e28bab tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1739 microversion: 2.20 time: 0.204266 Jul 12 17:36:01.077471 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 483/942] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:00 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:02.084625 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-50bc2930-9145-4259-ba33-87c5fcfb1efe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:02.086786 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-50bc2930-9145-4259-ba33-87c5fcfb1efe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:02.094045 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=28 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:36:02.096920 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-50bc2930-9145-4259-ba33-87c5fcfb1efe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:02.097849 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-50bc2930-9145-4259-ba33-87c5fcfb1efe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:02.100285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-50bc2930-9145-4259-ba33-87c5fcfb1efe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:02.100864 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-50bc2930-9145-4259-ba33-87c5fcfb1efe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:02.110353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=84 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:36:02.310822 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-50bc2930-9145-4259-ba33-87c5fcfb1efe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:02.320284 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-50bc2930-9145-4259-ba33-87c5fcfb1efe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:02.321827 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-50bc2930-9145-4259-ba33-87c5fcfb1efe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:02.323523 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-50bc2930-9145-4259-ba33-87c5fcfb1efe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1739 microversion: 2.20 time: 0.242986 Jul 12 17:36:02.324265 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 460/943] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:02 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:03.342251 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3341d472-8d7e-44e7-90ae-a67fd12d32ed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:03.342919 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3341d472-8d7e-44e7-90ae-a67fd12d32ed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:03.349635 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3341d472-8d7e-44e7-90ae-a67fd12d32ed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:03.350112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3341d472-8d7e-44e7-90ae-a67fd12d32ed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:03.350866 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3341d472-8d7e-44e7-90ae-a67fd12d32ed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:03.351293 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3341d472-8d7e-44e7-90ae-a67fd12d32ed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:03.495770 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3341d472-8d7e-44e7-90ae-a67fd12d32ed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:03.504220 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3341d472-8d7e-44e7-90ae-a67fd12d32ed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:03.505731 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3341d472-8d7e-44e7-90ae-a67fd12d32ed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:03.507072 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3341d472-8d7e-44e7-90ae-a67fd12d32ed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1739 microversion: 2.20 time: 0.169233 Jul 12 17:36:03.507633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 484/944] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:03 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:04.300062 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-464394e9-11fe-4dcb-850b-8bd73686bca2 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:04.300591 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-464394e9-11fe-4dcb-850b-8bd73686bca2 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: cac1d452-9d15-4985-9ca6-09878db8969e] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:04.307718 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-464394e9-11fe-4dcb-850b-8bd73686bca2 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:04.308165 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-464394e9-11fe-4dcb-850b-8bd73686bca2 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:04.308943 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-464394e9-11fe-4dcb-850b-8bd73686bca2 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:04.309386 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-464394e9-11fe-4dcb-850b-8bd73686bca2 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:04.404366 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-464394e9-11fe-4dcb-850b-8bd73686bca2 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lazy-loading 'services' on Instance uuid cac1d452-9d15-4985-9ca6-09878db8969e {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:36:04.492293 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-464394e9-11fe-4dcb-850b-8bd73686bca2 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e/os-volume_attachments/4083d101-cf14-4ab4-b309-b4e1240ba1ca" status: 202 len: 0 microversion: 2.1 time: 0.195999 Jul 12 17:36:04.493576 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 461/945] 10.222.0.62 () {58 vars in 1415 bytes} [Tue Jul 12 17:36:04 2022] DELETE /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e/os-volume_attachments/4083d101-cf14-4ab4-b309-b4e1240ba1ca => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:36:04.528383 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fba02a99-5452-4947-8eed-04dc02c00738 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:04.529809 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fba02a99-5452-4947-8eed-04dc02c00738 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:04.540463 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fba02a99-5452-4947-8eed-04dc02c00738 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:04.540920 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fba02a99-5452-4947-8eed-04dc02c00738 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:04.541776 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fba02a99-5452-4947-8eed-04dc02c00738 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:04.542202 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fba02a99-5452-4947-8eed-04dc02c00738 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:04.707491 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fba02a99-5452-4947-8eed-04dc02c00738 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:04.716240 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fba02a99-5452-4947-8eed-04dc02c00738 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:04.717777 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fba02a99-5452-4947-8eed-04dc02c00738 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:04.719051 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fba02a99-5452-4947-8eed-04dc02c00738 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1739 microversion: 2.20 time: 0.196981 Jul 12 17:36:04.723761 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 485/946] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:04 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:05.738240 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-83e2445a-2048-431f-ba9d-4d07fa0206c3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:05.738935 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-83e2445a-2048-431f-ba9d-4d07fa0206c3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:05.745082 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-83e2445a-2048-431f-ba9d-4d07fa0206c3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:05.745525 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-83e2445a-2048-431f-ba9d-4d07fa0206c3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:05.746329 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-83e2445a-2048-431f-ba9d-4d07fa0206c3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:05.746760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-83e2445a-2048-431f-ba9d-4d07fa0206c3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:05.874134 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-83e2445a-2048-431f-ba9d-4d07fa0206c3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:05.881856 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-83e2445a-2048-431f-ba9d-4d07fa0206c3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:05.883399 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-83e2445a-2048-431f-ba9d-4d07fa0206c3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:05.884541 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-83e2445a-2048-431f-ba9d-4d07fa0206c3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1739 microversion: 2.20 time: 0.151089 Jul 12 17:36:05.885591 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 462/947] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:05 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:06.903525 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5e88c7d8-5989-4019-a7df-92a3240866fa tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:06.904074 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5e88c7d8-5989-4019-a7df-92a3240866fa tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:06.910664 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5e88c7d8-5989-4019-a7df-92a3240866fa tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:06.911114 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5e88c7d8-5989-4019-a7df-92a3240866fa tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:06.911894 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5e88c7d8-5989-4019-a7df-92a3240866fa tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:06.912322 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5e88c7d8-5989-4019-a7df-92a3240866fa tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:07.091907 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5e88c7d8-5989-4019-a7df-92a3240866fa tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:07.099773 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5e88c7d8-5989-4019-a7df-92a3240866fa tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:07.101284 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5e88c7d8-5989-4019-a7df-92a3240866fa tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:07.102469 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5e88c7d8-5989-4019-a7df-92a3240866fa tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1721 microversion: 2.20 time: 0.203415 Jul 12 17:36:07.103023 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 486/948] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:06 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:07.734675 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5e8a100c-879d-44c2-a318-9c50b4eba2e1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:07.735215 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5e8a100c-879d-44c2-a318-9c50b4eba2e1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: cac1d452-9d15-4985-9ca6-09878db8969e] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:07.741678 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e8a100c-879d-44c2-a318-9c50b4eba2e1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:07.742187 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e8a100c-879d-44c2-a318-9c50b4eba2e1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:07.742957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e8a100c-879d-44c2-a318-9c50b4eba2e1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:07.743398 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5e8a100c-879d-44c2-a318-9c50b4eba2e1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:07.769185 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5e8a100c-879d-44c2-a318-9c50b4eba2e1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: cac1d452-9d15-4985-9ca6-09878db8969e] Going to try to terminate instance {{(pid=117939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:36:07.845048 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5e8a100c-879d-44c2-a318-9c50b4eba2e1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e" status: 204 len: 0 microversion: 2.1 time: 0.114029 Jul 12 17:36:07.845610 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 463/949] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:36:07 2022] DELETE /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:36:07.853870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5fea8d8b-dcfc-412d-8fe9-4d2240d7d0de tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:07.854480 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5fea8d8b-dcfc-412d-8fe9-4d2240d7d0de tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: cac1d452-9d15-4985-9ca6-09878db8969e] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:07.860400 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5fea8d8b-dcfc-412d-8fe9-4d2240d7d0de tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:07.860847 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5fea8d8b-dcfc-412d-8fe9-4d2240d7d0de tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:07.861601 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5fea8d8b-dcfc-412d-8fe9-4d2240d7d0de tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:07.862060 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5fea8d8b-dcfc-412d-8fe9-4d2240d7d0de tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:07.987691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5fea8d8b-dcfc-412d-8fe9-4d2240d7d0de tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:07.995789 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5fea8d8b-dcfc-412d-8fe9-4d2240d7d0de tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e" status: 200 len: 1512 microversion: 2.1 time: 0.145822 Jul 12 17:36:07.996355 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 487/950] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:07 2022] GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e => generated 1512 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:08.122040 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2998f070-00c2-40bc-84a5-14a8a4f89201 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:08.122790 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2998f070-00c2-40bc-84a5-14a8a4f89201 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:08.129599 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2998f070-00c2-40bc-84a5-14a8a4f89201 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:08.130072 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2998f070-00c2-40bc-84a5-14a8a4f89201 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:08.130866 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2998f070-00c2-40bc-84a5-14a8a4f89201 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:08.131297 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2998f070-00c2-40bc-84a5-14a8a4f89201 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:08.262486 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2998f070-00c2-40bc-84a5-14a8a4f89201 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:08.270283 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2998f070-00c2-40bc-84a5-14a8a4f89201 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:08.271782 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2998f070-00c2-40bc-84a5-14a8a4f89201 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:08.272919 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2998f070-00c2-40bc-84a5-14a8a4f89201 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1721 microversion: 2.20 time: 0.156015 Jul 12 17:36:08.273460 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 464/951] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:08 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:08.312193 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:36:08.312354 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Tue Jul 12 17:36:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:36:08.896758 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-747f5065-ffac-45bf-8a56-e919e1c07e74 req-5ce49412-18e4-4d04-ac4f-d464088ffbdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeedc087-222c-4452-bf37-2f152ce787a6", "name": "network-vif-unplugged", "status": "completed", "tag": "c8a34f14-81f6-401c-83f7-ce051f443de8"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:36:08.905609 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-747f5065-ffac-45bf-8a56-e919e1c07e74 req-5ce49412-18e4-4d04-ac4f-d464088ffbdb service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:08.906095 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-747f5065-ffac-45bf-8a56-e919e1c07e74 req-5ce49412-18e4-4d04-ac4f-d464088ffbdb service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:08.917948 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-747f5065-ffac-45bf-8a56-e919e1c07e74 req-5ce49412-18e4-4d04-ac4f-d464088ffbdb service nova] Creating event network-vif-unplugged:c8a34f14-81f6-401c-83f7-ce051f443de8 for instance aeedc087-222c-4452-bf37-2f152ce787a6 on hv-cinder-84932 Jul 12 17:36:08.922793 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-747f5065-ffac-45bf-8a56-e919e1c07e74 req-5ce49412-18e4-4d04-ac4f-d464088ffbdb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029845 Jul 12 17:36:08.923382 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 488/952] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:36:09.012888 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e9e680fa-07f9-4e55-928e-412efb22bca3 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:09.013527 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e9e680fa-07f9-4e55-928e-412efb22bca3 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: cac1d452-9d15-4985-9ca6-09878db8969e] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:09.019922 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e9e680fa-07f9-4e55-928e-412efb22bca3 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:09.020365 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e9e680fa-07f9-4e55-928e-412efb22bca3 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:09.021123 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e9e680fa-07f9-4e55-928e-412efb22bca3 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:09.021556 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e9e680fa-07f9-4e55-928e-412efb22bca3 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:09.146695 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e9e680fa-07f9-4e55-928e-412efb22bca3 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:09.153990 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e9e680fa-07f9-4e55-928e-412efb22bca3 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e" status: 200 len: 1512 microversion: 2.1 time: 0.145515 Jul 12 17:36:09.154546 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 465/953] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:09 2022] GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e => generated 1512 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:09.290521 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2eed0373-4514-4aa8-9a77-2b436bcdcd3f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:09.291264 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2eed0373-4514-4aa8-9a77-2b436bcdcd3f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:09.297357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2eed0373-4514-4aa8-9a77-2b436bcdcd3f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:09.297837 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2eed0373-4514-4aa8-9a77-2b436bcdcd3f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:09.298598 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2eed0373-4514-4aa8-9a77-2b436bcdcd3f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:09.299032 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2eed0373-4514-4aa8-9a77-2b436bcdcd3f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:09.669842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2eed0373-4514-4aa8-9a77-2b436bcdcd3f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:09.677620 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2eed0373-4514-4aa8-9a77-2b436bcdcd3f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:09.679150 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2eed0373-4514-4aa8-9a77-2b436bcdcd3f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:09.680307 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2eed0373-4514-4aa8-9a77-2b436bcdcd3f tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1721 microversion: 2.20 time: 0.394018 Jul 12 17:36:09.680857 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 489/954] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:09 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1721 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:10.171080 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1847ddf9-87cf-4f1e-a7dd-bf20d528788a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:10.171727 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1847ddf9-87cf-4f1e-a7dd-bf20d528788a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: cac1d452-9d15-4985-9ca6-09878db8969e] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:10.178549 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1847ddf9-87cf-4f1e-a7dd-bf20d528788a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:10.179034 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1847ddf9-87cf-4f1e-a7dd-bf20d528788a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:10.179813 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1847ddf9-87cf-4f1e-a7dd-bf20d528788a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:10.180275 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1847ddf9-87cf-4f1e-a7dd-bf20d528788a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:10.307826 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1847ddf9-87cf-4f1e-a7dd-bf20d528788a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:10.315239 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1847ddf9-87cf-4f1e-a7dd-bf20d528788a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e" status: 200 len: 1512 microversion: 2.1 time: 0.148887 Jul 12 17:36:10.316065 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 466/955] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:10 2022] GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:10.698560 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4cf9b608-1524-49c6-aa45-e05a2c925b81 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:10.700083 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4cf9b608-1524-49c6-aa45-e05a2c925b81 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:10.706487 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4cf9b608-1524-49c6-aa45-e05a2c925b81 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:10.706932 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4cf9b608-1524-49c6-aa45-e05a2c925b81 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:10.707681 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4cf9b608-1524-49c6-aa45-e05a2c925b81 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:10.708111 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4cf9b608-1524-49c6-aa45-e05a2c925b81 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:10.909309 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4cf9b608-1524-49c6-aa45-e05a2c925b81 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:10.917103 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4cf9b608-1524-49c6-aa45-e05a2c925b81 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:10.918672 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4cf9b608-1524-49c6-aa45-e05a2c925b81 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:10.919824 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4cf9b608-1524-49c6-aa45-e05a2c925b81 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1724 microversion: 2.20 time: 0.225176 Jul 12 17:36:10.925869 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 490/956] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:10 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:10.938403 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9a7e9d0e-ec8e-45e6-8379-779df74d56f6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e12bee6f-79e2-4f97-a813-07c06be2dcba"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:36:10.939644 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9a7e9d0e-ec8e-45e6-8379-779df74d56f6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:10.945977 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9a7e9d0e-ec8e-45e6-8379-779df74d56f6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:10.946523 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9a7e9d0e-ec8e-45e6-8379-779df74d56f6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:10.947353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9a7e9d0e-ec8e-45e6-8379-779df74d56f6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:10.947860 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9a7e9d0e-ec8e-45e6-8379-779df74d56f6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:11.226246 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9a7e9d0e-ec8e-45e6-8379-779df74d56f6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "POST /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.292733 Jul 12 17:36:11.226951 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 467/957] 10.222.0.62 () {62 vars in 1363 bytes} [Tue Jul 12 17:36:10 2022] POST /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6/os-volume_attachments => generated 188 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 17:36:11.306219 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-047b54ca-5be4-44af-99cc-4dce495e86f1 req-5ac74bac-714e-4fea-8662-b437b0a169a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cac1d452-9d15-4985-9ca6-09878db8969e", "name": "network-vif-deleted", "tag": "81d557a0-e82f-4305-ae59-2f74edbd8cab"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:36:11.314739 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-047b54ca-5be4-44af-99cc-4dce495e86f1 req-5ac74bac-714e-4fea-8662-b437b0a169a9 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:11.315165 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-047b54ca-5be4-44af-99cc-4dce495e86f1 req-5ac74bac-714e-4fea-8662-b437b0a169a9 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:11.326464 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-047b54ca-5be4-44af-99cc-4dce495e86f1 req-5ac74bac-714e-4fea-8662-b437b0a169a9 service nova] Creating event network-vif-deleted:81d557a0-e82f-4305-ae59-2f74edbd8cab for instance cac1d452-9d15-4985-9ca6-09878db8969e on hv-cinder-84932 Jul 12 17:36:11.331550 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-047b54ca-5be4-44af-99cc-4dce495e86f1 req-5ac74bac-714e-4fea-8662-b437b0a169a9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028766 Jul 12 17:36:11.332421 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f2ed3291-e5f8-4476-a129-8c93a6c64069 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:11.332913 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 491/958] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:36:11.340059 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f2ed3291-e5f8-4476-a129-8c93a6c64069 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: cac1d452-9d15-4985-9ca6-09878db8969e] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:11.346539 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f2ed3291-e5f8-4476-a129-8c93a6c64069 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:11.347007 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f2ed3291-e5f8-4476-a129-8c93a6c64069 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:11.347973 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f2ed3291-e5f8-4476-a129-8c93a6c64069 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:11.348411 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f2ed3291-e5f8-4476-a129-8c93a6c64069 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:11.356959 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-83f2e16f-670f-4daf-8d30-6018c3b315e6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:11.366918 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-83f2e16f-670f-4daf-8d30-6018c3b315e6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:11.373585 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-83f2e16f-670f-4daf-8d30-6018c3b315e6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:11.374184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-83f2e16f-670f-4daf-8d30-6018c3b315e6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:11.375113 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-83f2e16f-670f-4daf-8d30-6018c3b315e6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:11.376420 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-83f2e16f-670f-4daf-8d30-6018c3b315e6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:11.411919 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f2ed3291-e5f8-4476-a129-8c93a6c64069 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:11.419872 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f2ed3291-e5f8-4476-a129-8c93a6c64069 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e" status: 200 len: 1304 microversion: 2.1 time: 0.091305 Jul 12 17:36:11.420776 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 468/959] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:11 2022] GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:11.618608 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-83f2e16f-670f-4daf-8d30-6018c3b315e6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "DELETE /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6/os-volume_attachments/e12bee6f-79e2-4f97-a813-07c06be2dcba" status: 202 len: 0 microversion: 2.20 time: 0.268052 Jul 12 17:36:11.619192 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 492/960] 10.222.0.62 () {60 vars in 1456 bytes} [Tue Jul 12 17:36:11 2022] DELETE /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6/os-volume_attachments/e12bee6f-79e2-4f97-a813-07c06be2dcba => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 12 17:36:11.673732 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3c18b804-3996-4e91-b08c-19bb83f8b7cb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:36:11.674308 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-3c18b804-3996-4e91-b08c-19bb83f8b7cb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:11.680259 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3c18b804-3996-4e91-b08c-19bb83f8b7cb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:11.680713 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3c18b804-3996-4e91-b08c-19bb83f8b7cb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:11.681483 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3c18b804-3996-4e91-b08c-19bb83f8b7cb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:11.681948 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-3c18b804-3996-4e91-b08c-19bb83f8b7cb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:11.767175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3c18b804-3996-4e91-b08c-19bb83f8b7cb tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "POST /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6/action" status: 202 len: 0 microversion: 2.20 time: 0.097438 Jul 12 17:36:11.770916 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 469/961] 10.222.0.62 () {62 vars in 1318 bytes} [Tue Jul 12 17:36:11 2022] POST /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:36:11.775912 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fb27dcc2-758a-4751-ac47-8b1d9dce5e56 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:11.776521 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fb27dcc2-758a-4751-ac47-8b1d9dce5e56 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:11.783702 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fb27dcc2-758a-4751-ac47-8b1d9dce5e56 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:11.784148 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fb27dcc2-758a-4751-ac47-8b1d9dce5e56 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:11.784927 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fb27dcc2-758a-4751-ac47-8b1d9dce5e56 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:11.785608 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fb27dcc2-758a-4751-ac47-8b1d9dce5e56 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:11.934722 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fb27dcc2-758a-4751-ac47-8b1d9dce5e56 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:11.943167 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fb27dcc2-758a-4751-ac47-8b1d9dce5e56 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:11.944674 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fb27dcc2-758a-4751-ac47-8b1d9dce5e56 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:11.945861 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fb27dcc2-758a-4751-ac47-8b1d9dce5e56 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1672 microversion: 2.20 time: 0.173900 Jul 12 17:36:11.946422 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 493/962] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:11 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:12.437371 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cfa383f1-b501-4504-95a5-4e3a56a1f048 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:12.438017 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-cfa383f1-b501-4504-95a5-4e3a56a1f048 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: cac1d452-9d15-4985-9ca6-09878db8969e] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:12.444183 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cfa383f1-b501-4504-95a5-4e3a56a1f048 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:12.444624 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cfa383f1-b501-4504-95a5-4e3a56a1f048 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:12.445378 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cfa383f1-b501-4504-95a5-4e3a56a1f048 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:12.445833 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-cfa383f1-b501-4504-95a5-4e3a56a1f048 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:12.459532 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-cfa383f1-b501-4504-95a5-4e3a56a1f048 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] HTTP exception thrown: Instance cac1d452-9d15-4985-9ca6-09878db8969e could not be found. Jul 12 17:36:12.461156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cfa383f1-b501-4504-95a5-4e3a56a1f048 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Request method failure captured: Jul 12 17:36:12.461156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e HTTP/1.1 Jul 12 17:36:12.461156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:36:12.461156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:36:12.461156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:36:12.461156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:36:12.461156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:36:12.461156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:36:12.461156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:36:12.461156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:36:12.461156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABizbDBcJz86alQYAVb9p_LcnmK8g0EspkDVYig1JqMpgS1e1IPXGIdQkVkwmKIWMsH_HYA1xJ8NfhFBZlcyHUooQzViWAbOl6olSWODt6UEqXFuayDtFnpiuCoAMxoAD0mGDZe0Y7UV5yt_PL550gfXeUNlTjgy6xUihlACzdYFacLITA Jul 12 17:36:12.461156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:36:12.461156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:36:12.461156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:36:12.461156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:36:12.461156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:36:12.461156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:36:12.461156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: a8791892016f411b83948dcc36e4b243 Jul 12 17:36:12.461156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2107844421 Jul 12 17:36:12.461156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:36:12.461156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:36:12.462792 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a8791892016f411b83948dcc36e4b243"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a8791892016f411b83948dcc36e4b243"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a8791892016f411b83948dcc36e4b243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a8791892016f411b83948dcc36e4b243", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:36:12.462792 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-VolumesSnapshotTestJSON-2107844421 Jul 12 17:36:12.462792 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: a8791892016f411b83948dcc36e4b243 Jul 12 17:36:12.462792 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2107844421 Jul 12 17:36:12.462792 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-VolumesSnapshotTestJSON-2107844421-project Jul 12 17:36:12.462792 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:36:12.462792 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:36:12.462792 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: 486e09fa46b8483aa1a0e38de1b70958 Jul 12 17:36:12.462792 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-VolumesSnapshotTestJSON-2107844421-project Jul 12 17:36:12.462792 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:36:12.462792 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance cac1d452-9d15-4985-9ca6-09878db8969e could not be found. Jul 12 17:36:12.462792 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': 'cac1d452-9d15-4985-9ca6-09878db8969e'} Jul 12 17:36:12.463772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:36:12.463772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:36:12.463772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:36:12.463772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:36:12.463772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:36:12.463772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:36:12.463772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:36:12.463772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:36:12.463772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:36:12.463772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:36:12.463772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cac1d452-9d15-4985-9ca6-09878db8969e could not be found. Jul 12 17:36:12.463772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:36:12.463772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:36:12.463772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:36:12.463772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:36:12.463772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:36:12.463772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:36:12.463772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:36:12.463772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:36:12.463772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:36:12.465087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:36:12.465087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:36:12.465087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:36:12.465087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:36:12.465087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:36:12.465087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:36:12.465087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:36:12.465087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cac1d452-9d15-4985-9ca6-09878db8969e could not be found. Jul 12 17:36:12.465087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:36:12.465087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:36:12.465087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:36:12.465087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:36:12.465087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:36:12.465087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:36:12.465087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:36:12.465087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:36:12.465087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cac1d452-9d15-4985-9ca6-09878db8969e could not be found. Jul 12 17:36:12.465087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:36:12.466290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-cfa383f1-b501-4504-95a5-4e3a56a1f048 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Returning 404 to user: Instance cac1d452-9d15-4985-9ca6-09878db8969e could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:36:12.466290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-cfa383f1-b501-4504-95a5-4e3a56a1f048 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e" status: 404 len: 111 microversion: 2.1 time: 0.030121 Jul 12 17:36:12.466290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 470/963] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:12 2022] GET /compute/v2.1/servers/cac1d452-9d15-4985-9ca6-09878db8969e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:36:12.964970 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6c717cc0-c882-4e1e-a290-39d19b4a81c8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:12.965580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6c717cc0-c882-4e1e-a290-39d19b4a81c8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:12.972144 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6c717cc0-c882-4e1e-a290-39d19b4a81c8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:12.972625 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6c717cc0-c882-4e1e-a290-39d19b4a81c8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:12.973400 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6c717cc0-c882-4e1e-a290-39d19b4a81c8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:12.973925 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6c717cc0-c882-4e1e-a290-39d19b4a81c8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:12.989566 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:36:13.107962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6c717cc0-c882-4e1e-a290-39d19b4a81c8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:13.115693 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6c717cc0-c882-4e1e-a290-39d19b4a81c8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:13.117175 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6c717cc0-c882-4e1e-a290-39d19b4a81c8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:13.118345 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6c717cc0-c882-4e1e-a290-39d19b4a81c8 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.157899 Jul 12 17:36:13.118897 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 494/964] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:12 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:14.136825 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-aa3e6064-3358-4f25-b1e1-507a8d366cd2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:14.137433 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-aa3e6064-3358-4f25-b1e1-507a8d366cd2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:14.145286 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aa3e6064-3358-4f25-b1e1-507a8d366cd2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:14.146143 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aa3e6064-3358-4f25-b1e1-507a8d366cd2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:14.147515 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aa3e6064-3358-4f25-b1e1-507a8d366cd2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:14.148308 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aa3e6064-3358-4f25-b1e1-507a8d366cd2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:14.165064 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=6,nova_cell1:UPDATE=6 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:36:14.279527 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-aa3e6064-3358-4f25-b1e1-507a8d366cd2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:14.287464 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-aa3e6064-3358-4f25-b1e1-507a8d366cd2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:14.289013 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-aa3e6064-3358-4f25-b1e1-507a8d366cd2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:14.290242 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-aa3e6064-3358-4f25-b1e1-507a8d366cd2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.157422 Jul 12 17:36:14.290800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 471/965] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:14 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:15.308505 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-075fc0d3-abcb-438b-90d6-7b2fe75b16e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:15.309114 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-075fc0d3-abcb-438b-90d6-7b2fe75b16e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:15.315775 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-075fc0d3-abcb-438b-90d6-7b2fe75b16e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:15.316257 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-075fc0d3-abcb-438b-90d6-7b2fe75b16e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:15.316979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-075fc0d3-abcb-438b-90d6-7b2fe75b16e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:15.317413 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-075fc0d3-abcb-438b-90d6-7b2fe75b16e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:15.458176 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-075fc0d3-abcb-438b-90d6-7b2fe75b16e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:15.465959 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-075fc0d3-abcb-438b-90d6-7b2fe75b16e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:15.467463 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-075fc0d3-abcb-438b-90d6-7b2fe75b16e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:15.468608 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-075fc0d3-abcb-438b-90d6-7b2fe75b16e7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.164298 Jul 12 17:36:15.469168 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 495/966] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:15 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:16.486666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f851d568-25e6-46ea-87ed-43cae339caed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:16.487286 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f851d568-25e6-46ea-87ed-43cae339caed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:16.493877 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f851d568-25e6-46ea-87ed-43cae339caed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:16.494336 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f851d568-25e6-46ea-87ed-43cae339caed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:16.495146 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f851d568-25e6-46ea-87ed-43cae339caed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:16.495587 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f851d568-25e6-46ea-87ed-43cae339caed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:16.659653 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f851d568-25e6-46ea-87ed-43cae339caed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:16.668338 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f851d568-25e6-46ea-87ed-43cae339caed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:16.669872 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f851d568-25e6-46ea-87ed-43cae339caed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:16.671083 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f851d568-25e6-46ea-87ed-43cae339caed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.188399 Jul 12 17:36:16.671638 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 472/967] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:16 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:17.690827 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b293ce09-8247-45e5-8e8d-cf41aa78e77a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:17.692216 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b293ce09-8247-45e5-8e8d-cf41aa78e77a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:17.700243 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b293ce09-8247-45e5-8e8d-cf41aa78e77a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:17.700708 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b293ce09-8247-45e5-8e8d-cf41aa78e77a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:17.701491 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b293ce09-8247-45e5-8e8d-cf41aa78e77a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:17.701965 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b293ce09-8247-45e5-8e8d-cf41aa78e77a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:17.855805 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b293ce09-8247-45e5-8e8d-cf41aa78e77a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:17.874398 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b293ce09-8247-45e5-8e8d-cf41aa78e77a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:17.876002 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b293ce09-8247-45e5-8e8d-cf41aa78e77a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:17.877267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b293ce09-8247-45e5-8e8d-cf41aa78e77a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.191996 Jul 12 17:36:17.878206 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 496/968] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:17 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:18.896859 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-950f601a-e6c7-4a29-93da-ae61197622d3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:18.898476 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-950f601a-e6c7-4a29-93da-ae61197622d3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:18.906780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-950f601a-e6c7-4a29-93da-ae61197622d3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:18.907532 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-950f601a-e6c7-4a29-93da-ae61197622d3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:18.908482 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-950f601a-e6c7-4a29-93da-ae61197622d3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:18.908921 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-950f601a-e6c7-4a29-93da-ae61197622d3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:19.050058 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-950f601a-e6c7-4a29-93da-ae61197622d3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:19.061392 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-950f601a-e6c7-4a29-93da-ae61197622d3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:19.063260 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-950f601a-e6c7-4a29-93da-ae61197622d3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:19.064523 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-950f601a-e6c7-4a29-93da-ae61197622d3 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.172018 Jul 12 17:36:19.065444 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 473/969] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:18 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:20.082941 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6a73e477-57f8-4799-86e7-a2b30721103b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:20.083582 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6a73e477-57f8-4799-86e7-a2b30721103b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:20.090848 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6a73e477-57f8-4799-86e7-a2b30721103b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:20.091305 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6a73e477-57f8-4799-86e7-a2b30721103b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:20.092059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6a73e477-57f8-4799-86e7-a2b30721103b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:20.092495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6a73e477-57f8-4799-86e7-a2b30721103b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:20.222339 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b73f6372-fc9e-421d-bc7c-23ee1286fdfd tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:36:20.223770 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b73f6372-fc9e-421d-bc7c-23ee1286fdfd tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:20.231130 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b73f6372-fc9e-421d-bc7c-23ee1286fdfd tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:20.238390 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6a73e477-57f8-4799-86e7-a2b30721103b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:20.247898 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b73f6372-fc9e-421d-bc7c-23ee1286fdfd tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:20.248946 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b73f6372-fc9e-421d-bc7c-23ee1286fdfd tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:20.249413 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6a73e477-57f8-4799-86e7-a2b30721103b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:20.249573 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b73f6372-fc9e-421d-bc7c-23ee1286fdfd tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:20.250938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6a73e477-57f8-4799-86e7-a2b30721103b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:20.252193 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6a73e477-57f8-4799-86e7-a2b30721103b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.173185 Jul 12 17:36:20.252801 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 497/970] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:20 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:20.279298 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-b73f6372-fc9e-421d-bc7c-23ee1286fdfd tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lazy-loading 'flavor' on Instance uuid bdfd07ca-55f6-48b2-b2c7-f202196e05ed {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:36:20.404402 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b73f6372-fc9e-421d-bc7c-23ee1286fdfd tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "POST /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed/action" status: 202 len: 0 microversion: 2.1 time: 0.186175 Jul 12 17:36:20.405658 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 474/971] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Jul 12 17:36:20 2022] POST /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:36:20.413588 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-58c9a869-e6ff-4feb-8d7e-8b755b288ef7 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:20.414317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-58c9a869-e6ff-4feb-8d7e-8b755b288ef7 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:20.420774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-58c9a869-e6ff-4feb-8d7e-8b755b288ef7 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:20.421221 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-58c9a869-e6ff-4feb-8d7e-8b755b288ef7 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:20.422012 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-58c9a869-e6ff-4feb-8d7e-8b755b288ef7 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:20.422592 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-58c9a869-e6ff-4feb-8d7e-8b755b288ef7 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:20.561473 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-58c9a869-e6ff-4feb-8d7e-8b755b288ef7 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:20.569216 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-58c9a869-e6ff-4feb-8d7e-8b755b288ef7 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.159568 Jul 12 17:36:20.569805 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 498/972] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:20 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:21.272096 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-270da208-c85f-4039-881a-a75fc6cf21f6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:21.272792 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-270da208-c85f-4039-881a-a75fc6cf21f6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:21.279673 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-270da208-c85f-4039-881a-a75fc6cf21f6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:21.280116 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-270da208-c85f-4039-881a-a75fc6cf21f6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:21.280888 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-270da208-c85f-4039-881a-a75fc6cf21f6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:21.281320 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-270da208-c85f-4039-881a-a75fc6cf21f6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:21.409510 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-270da208-c85f-4039-881a-a75fc6cf21f6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:21.418049 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-270da208-c85f-4039-881a-a75fc6cf21f6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:21.419570 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-270da208-c85f-4039-881a-a75fc6cf21f6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:21.420718 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-270da208-c85f-4039-881a-a75fc6cf21f6 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.153433 Jul 12 17:36:21.421277 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 475/973] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:21 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:21.588378 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-95bb1598-ec7d-4a8a-8806-3ea95797634c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:21.589645 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-95bb1598-ec7d-4a8a-8806-3ea95797634c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:21.596137 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-95bb1598-ec7d-4a8a-8806-3ea95797634c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:21.596588 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-95bb1598-ec7d-4a8a-8806-3ea95797634c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:21.597345 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-95bb1598-ec7d-4a8a-8806-3ea95797634c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:21.597807 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-95bb1598-ec7d-4a8a-8806-3ea95797634c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:21.730691 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-95bb1598-ec7d-4a8a-8806-3ea95797634c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:21.738230 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-95bb1598-ec7d-4a8a-8806-3ea95797634c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.153675 Jul 12 17:36:21.738900 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 499/974] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:21 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:22.439236 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-08559f6c-d920-4aa8-8be8-27ac53f46138 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:22.439854 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-08559f6c-d920-4aa8-8be8-27ac53f46138 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:22.447017 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08559f6c-d920-4aa8-8be8-27ac53f46138 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:22.447468 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08559f6c-d920-4aa8-8be8-27ac53f46138 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:22.448308 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08559f6c-d920-4aa8-8be8-27ac53f46138 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:22.448748 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-08559f6c-d920-4aa8-8be8-27ac53f46138 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:22.586191 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-08559f6c-d920-4aa8-8be8-27ac53f46138 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:22.595990 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-08559f6c-d920-4aa8-8be8-27ac53f46138 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:22.597497 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-08559f6c-d920-4aa8-8be8-27ac53f46138 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:22.598885 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-08559f6c-d920-4aa8-8be8-27ac53f46138 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.163562 Jul 12 17:36:22.600179 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 476/975] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:22 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:22.755309 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-51acd3cd-8ad5-46e7-a799-d2c464c8a120 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:22.755927 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-51acd3cd-8ad5-46e7-a799-d2c464c8a120 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:22.763653 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-51acd3cd-8ad5-46e7-a799-d2c464c8a120 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:22.764448 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-51acd3cd-8ad5-46e7-a799-d2c464c8a120 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:22.765669 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-51acd3cd-8ad5-46e7-a799-d2c464c8a120 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:22.766286 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-51acd3cd-8ad5-46e7-a799-d2c464c8a120 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:22.911165 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-51acd3cd-8ad5-46e7-a799-d2c464c8a120 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:22.920414 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-51acd3cd-8ad5-46e7-a799-d2c464c8a120 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.168869 Jul 12 17:36:22.921267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 500/976] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:22 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:23.618838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-084743fc-0098-435d-8efe-a1de1c965f9e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:23.619457 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-084743fc-0098-435d-8efe-a1de1c965f9e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:23.626439 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-084743fc-0098-435d-8efe-a1de1c965f9e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:23.626894 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-084743fc-0098-435d-8efe-a1de1c965f9e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:23.627664 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-084743fc-0098-435d-8efe-a1de1c965f9e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:23.628109 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-084743fc-0098-435d-8efe-a1de1c965f9e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:23.754926 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-084743fc-0098-435d-8efe-a1de1c965f9e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:23.763318 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-084743fc-0098-435d-8efe-a1de1c965f9e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:23.764873 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-084743fc-0098-435d-8efe-a1de1c965f9e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:23.766076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-084743fc-0098-435d-8efe-a1de1c965f9e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.151157 Jul 12 17:36:23.766642 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 477/977] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:23 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:23.938205 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ad932ce4-da8b-4223-92c6-72838d97074e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:23.938897 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ad932ce4-da8b-4223-92c6-72838d97074e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:23.942435 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=42 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:36:23.946277 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ad932ce4-da8b-4223-92c6-72838d97074e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:23.946708 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ad932ce4-da8b-4223-92c6-72838d97074e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:23.947514 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ad932ce4-da8b-4223-92c6-72838d97074e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:23.947947 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ad932ce4-da8b-4223-92c6-72838d97074e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:24.087519 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ad932ce4-da8b-4223-92c6-72838d97074e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:24.095517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ad932ce4-da8b-4223-92c6-72838d97074e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.161206 Jul 12 17:36:24.096090 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 501/978] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:23 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:24.784402 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0a2dacf9-2f08-41f4-9889-27423b8aaa18 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:24.785014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0a2dacf9-2f08-41f4-9889-27423b8aaa18 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:24.792890 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0a2dacf9-2f08-41f4-9889-27423b8aaa18 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:24.793339 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0a2dacf9-2f08-41f4-9889-27423b8aaa18 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:24.794186 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0a2dacf9-2f08-41f4-9889-27423b8aaa18 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:24.794628 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0a2dacf9-2f08-41f4-9889-27423b8aaa18 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:24.926954 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0a2dacf9-2f08-41f4-9889-27423b8aaa18 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:24.934683 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0a2dacf9-2f08-41f4-9889-27423b8aaa18 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:24.936179 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0a2dacf9-2f08-41f4-9889-27423b8aaa18 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:24.937319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0a2dacf9-2f08-41f4-9889-27423b8aaa18 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.156890 Jul 12 17:36:24.937895 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 478/979] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:24 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:25.112656 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-44d35b4e-7458-44e7-93e6-4ec2d0987371 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:25.113293 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-44d35b4e-7458-44e7-93e6-4ec2d0987371 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:25.119781 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-44d35b4e-7458-44e7-93e6-4ec2d0987371 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:25.120750 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-44d35b4e-7458-44e7-93e6-4ec2d0987371 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:25.121502 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-44d35b4e-7458-44e7-93e6-4ec2d0987371 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:25.121969 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-44d35b4e-7458-44e7-93e6-4ec2d0987371 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:25.249917 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-44d35b4e-7458-44e7-93e6-4ec2d0987371 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:25.257282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-44d35b4e-7458-44e7-93e6-4ec2d0987371 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.148504 Jul 12 17:36:25.257914 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 502/980] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:25 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:25.955410 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-be5fda1e-6227-4618-8688-325a67563827 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:25.956031 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-be5fda1e-6227-4618-8688-325a67563827 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:25.962569 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-be5fda1e-6227-4618-8688-325a67563827 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:25.963023 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-be5fda1e-6227-4618-8688-325a67563827 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:25.964482 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-be5fda1e-6227-4618-8688-325a67563827 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:25.964921 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-be5fda1e-6227-4618-8688-325a67563827 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:26.094579 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-be5fda1e-6227-4618-8688-325a67563827 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:26.102408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-be5fda1e-6227-4618-8688-325a67563827 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:26.103930 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-be5fda1e-6227-4618-8688-325a67563827 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:26.105111 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-be5fda1e-6227-4618-8688-325a67563827 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.153741 Jul 12 17:36:26.105672 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 479/981] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:25 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:26.274191 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5eb8c3a7-fc17-439b-ad67-2f43c2afd5e1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:26.274886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5eb8c3a7-fc17-439b-ad67-2f43c2afd5e1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:26.282245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5eb8c3a7-fc17-439b-ad67-2f43c2afd5e1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:26.282747 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5eb8c3a7-fc17-439b-ad67-2f43c2afd5e1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:26.283517 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5eb8c3a7-fc17-439b-ad67-2f43c2afd5e1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:26.284001 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5eb8c3a7-fc17-439b-ad67-2f43c2afd5e1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:26.420606 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5eb8c3a7-fc17-439b-ad67-2f43c2afd5e1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:26.427892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5eb8c3a7-fc17-439b-ad67-2f43c2afd5e1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.157562 Jul 12 17:36:26.428452 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 503/982] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:26 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:26.476891 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1f085d26-8601-4d16-81da-7279e1dfde8c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-184574385", "imageRef": "b19e7830-75c9-4706-bd34-4954ba6b4cc1", "flavorRef": "452", "networks": [{"uuid": "b01fc38d-33fc-45c5-8ac6-f70c9354cbe7"}]}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:36:26.531023 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.network.neutron [None req-1f085d26-8601-4d16-81da-7279e1dfde8c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] validate_networks() for [('b01fc38d-33fc-45c5-8ac6-f70c9354cbe7', None, None, None, None, None)] {{(pid=117939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:36:26.971382 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-1f085d26-8601-4d16-81da-7279e1dfde8c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Flavor limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:36:26.972043 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-1f085d26-8601-4d16-81da-7279e1dfde8c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Image limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:36:26.972673 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-1f085d26-8601-4d16-81da-7279e1dfde8c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Flavor pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:36:26.973311 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-1f085d26-8601-4d16-81da-7279e1dfde8c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Image pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:36:26.973912 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-1f085d26-8601-4d16-81da-7279e1dfde8c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:36:26.985184 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1f085d26-8601-4d16-81da-7279e1dfde8c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:26.986018 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1f085d26-8601-4d16-81da-7279e1dfde8c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:26.986854 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1f085d26-8601-4d16-81da-7279e1dfde8c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:26.987287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1f085d26-8601-4d16-81da-7279e1dfde8c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:27.004301 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-1f085d26-8601-4d16-81da-7279e1dfde8c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Getting quotas for project a8791892016f411b83948dcc36e4b243. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:36:27.008186 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-1f085d26-8601-4d16-81da-7279e1dfde8c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Getting quotas for user 486e09fa46b8483aa1a0e38de1b70958 and project a8791892016f411b83948dcc36e4b243. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:36:27.019876 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1f085d26-8601-4d16-81da-7279e1dfde8c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Going to run 1 instances... {{(pid=117939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:36:27.022173 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1f085d26-8601-4d16-81da-7279e1dfde8c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19e7830-75c9-4706-bd34-4954ba6b4cc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:36:27.069858 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1f085d26-8601-4d16-81da-7279e1dfde8c tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597056 Jul 12 17:36:27.070498 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 480/983] 10.222.0.62 () {60 vars in 1146 bytes} [Tue Jul 12 17:36:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:36:27.084797 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-797b1dc8-5545-47b0-b7d9-63e1d65b0193 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:27.085657 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-797b1dc8-5545-47b0-b7d9-63e1d65b0193 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:27.124050 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-69dcda62-7a0c-4b39-8549-95b949101297 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:27.124675 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-69dcda62-7a0c-4b39-8549-95b949101297 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:27.133712 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-69dcda62-7a0c-4b39-8549-95b949101297 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:27.137906 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-69dcda62-7a0c-4b39-8549-95b949101297 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:27.140418 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-69dcda62-7a0c-4b39-8549-95b949101297 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:27.140999 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-69dcda62-7a0c-4b39-8549-95b949101297 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:27.153629 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-797b1dc8-5545-47b0-b7d9-63e1d65b0193 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:27.176202 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-797b1dc8-5545-47b0-b7d9-63e1d65b0193 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1218 microversion: 2.1 time: 0.093142 Jul 12 17:36:27.197908 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 504/984] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:27 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:27.322045 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-69dcda62-7a0c-4b39-8549-95b949101297 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:27.330661 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-69dcda62-7a0c-4b39-8549-95b949101297 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:27.332235 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-69dcda62-7a0c-4b39-8549-95b949101297 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:27.333451 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-69dcda62-7a0c-4b39-8549-95b949101297 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.214381 Jul 12 17:36:27.334249 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 481/985] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:27 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:36:27.444668 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bbb8b632-6d73-4069-a0e6-f8f065f78405 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:27.445240 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bbb8b632-6d73-4069-a0e6-f8f065f78405 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:27.453305 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bbb8b632-6d73-4069-a0e6-f8f065f78405 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:27.453939 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bbb8b632-6d73-4069-a0e6-f8f065f78405 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:27.454711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bbb8b632-6d73-4069-a0e6-f8f065f78405 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:27.455177 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bbb8b632-6d73-4069-a0e6-f8f065f78405 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:27.614516 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bbb8b632-6d73-4069-a0e6-f8f065f78405 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:27.622348 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bbb8b632-6d73-4069-a0e6-f8f065f78405 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.181577 Jul 12 17:36:27.622900 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 505/986] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:27 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:28.202217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-aca8ff2c-7997-4ffb-be86-c8e6f0b2ee22 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:28.203127 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-aca8ff2c-7997-4ffb-be86-c8e6f0b2ee22 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:28.209897 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aca8ff2c-7997-4ffb-be86-c8e6f0b2ee22 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:28.210426 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aca8ff2c-7997-4ffb-be86-c8e6f0b2ee22 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:28.211290 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aca8ff2c-7997-4ffb-be86-c8e6f0b2ee22 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:28.211796 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aca8ff2c-7997-4ffb-be86-c8e6f0b2ee22 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:28.281240 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-aca8ff2c-7997-4ffb-be86-c8e6f0b2ee22 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:28.288793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-aca8ff2c-7997-4ffb-be86-c8e6f0b2ee22 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1222 microversion: 2.1 time: 0.090431 Jul 12 17:36:28.289372 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 482/987] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:28 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:28.351766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c72c622f-6738-4819-98fe-98ef97179590 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:28.352423 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c72c622f-6738-4819-98fe-98ef97179590 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:28.359402 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c72c622f-6738-4819-98fe-98ef97179590 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:28.359848 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c72c622f-6738-4819-98fe-98ef97179590 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:28.360651 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c72c622f-6738-4819-98fe-98ef97179590 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:28.361080 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c72c622f-6738-4819-98fe-98ef97179590 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:28.500778 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c72c622f-6738-4819-98fe-98ef97179590 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:28.509342 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c72c622f-6738-4819-98fe-98ef97179590 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:28.511433 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c72c622f-6738-4819-98fe-98ef97179590 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:28.513017 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c72c622f-6738-4819-98fe-98ef97179590 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.165285 Jul 12 17:36:28.514174 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 506/988] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:28 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:28.639555 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-68ca6c1c-ffaf-4e12-8b3c-fb8ecb70ec1f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:28.640161 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-68ca6c1c-ffaf-4e12-8b3c-fb8ecb70ec1f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:28.646228 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-68ca6c1c-ffaf-4e12-8b3c-fb8ecb70ec1f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:28.646673 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-68ca6c1c-ffaf-4e12-8b3c-fb8ecb70ec1f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:28.647439 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-68ca6c1c-ffaf-4e12-8b3c-fb8ecb70ec1f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:28.647871 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-68ca6c1c-ffaf-4e12-8b3c-fb8ecb70ec1f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:28.793858 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-68ca6c1c-ffaf-4e12-8b3c-fb8ecb70ec1f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:28.801566 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-68ca6c1c-ffaf-4e12-8b3c-fb8ecb70ec1f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.165862 Jul 12 17:36:28.802403 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 483/989] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:28 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:29.306189 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d8324173-57d2-4e67-acd1-baddf34d6b40 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:29.306899 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d8324173-57d2-4e67-acd1-baddf34d6b40 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:29.313641 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d8324173-57d2-4e67-acd1-baddf34d6b40 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:29.314127 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d8324173-57d2-4e67-acd1-baddf34d6b40 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:29.315164 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d8324173-57d2-4e67-acd1-baddf34d6b40 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:29.315894 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d8324173-57d2-4e67-acd1-baddf34d6b40 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:29.381043 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d8324173-57d2-4e67-acd1-baddf34d6b40 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:29.389068 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d8324173-57d2-4e67-acd1-baddf34d6b40 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1222 microversion: 2.1 time: 0.086970 Jul 12 17:36:29.389648 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 507/990] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:29 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:29.532388 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c9d509a3-d5e1-4f03-a188-4f696a6a93bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:29.532991 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c9d509a3-d5e1-4f03-a188-4f696a6a93bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:29.539913 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c9d509a3-d5e1-4f03-a188-4f696a6a93bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:29.540364 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c9d509a3-d5e1-4f03-a188-4f696a6a93bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:29.541144 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c9d509a3-d5e1-4f03-a188-4f696a6a93bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:29.541584 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c9d509a3-d5e1-4f03-a188-4f696a6a93bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:29.675585 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c9d509a3-d5e1-4f03-a188-4f696a6a93bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:29.685355 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c9d509a3-d5e1-4f03-a188-4f696a6a93bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:29.686905 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c9d509a3-d5e1-4f03-a188-4f696a6a93bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:29.688068 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c9d509a3-d5e1-4f03-a188-4f696a6a93bd tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.159620 Jul 12 17:36:29.688625 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 484/991] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:29 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:29.818623 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-56470977-d746-4564-acc7-f5d66d18ba82 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:29.819262 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-56470977-d746-4564-acc7-f5d66d18ba82 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:29.825604 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-56470977-d746-4564-acc7-f5d66d18ba82 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:29.826088 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-56470977-d746-4564-acc7-f5d66d18ba82 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:29.826853 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-56470977-d746-4564-acc7-f5d66d18ba82 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:29.827286 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-56470977-d746-4564-acc7-f5d66d18ba82 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:29.956561 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-56470977-d746-4564-acc7-f5d66d18ba82 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:29.963996 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-56470977-d746-4564-acc7-f5d66d18ba82 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.149528 Jul 12 17:36:29.964557 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 508/992] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:29 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:30.405446 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1c9519e8-fb7c-494f-80b3-b541b6a2e772 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:30.406076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1c9519e8-fb7c-494f-80b3-b541b6a2e772 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:30.412097 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c9519e8-fb7c-494f-80b3-b541b6a2e772 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:30.412542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c9519e8-fb7c-494f-80b3-b541b6a2e772 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:30.413297 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c9519e8-fb7c-494f-80b3-b541b6a2e772 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:30.413753 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1c9519e8-fb7c-494f-80b3-b541b6a2e772 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:30.476538 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1c9519e8-fb7c-494f-80b3-b541b6a2e772 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:30.483848 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1c9519e8-fb7c-494f-80b3-b541b6a2e772 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1222 microversion: 2.1 time: 0.082729 Jul 12 17:36:30.484415 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 485/993] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:30 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:30.706265 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-15885a09-7651-4dd1-81a8-a70de2312981 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:30.706802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-15885a09-7651-4dd1-81a8-a70de2312981 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:30.712715 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15885a09-7651-4dd1-81a8-a70de2312981 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:30.713161 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15885a09-7651-4dd1-81a8-a70de2312981 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:30.713950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15885a09-7651-4dd1-81a8-a70de2312981 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:30.714385 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15885a09-7651-4dd1-81a8-a70de2312981 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:30.840234 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-15885a09-7651-4dd1-81a8-a70de2312981 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:30.847988 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-15885a09-7651-4dd1-81a8-a70de2312981 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:30.849496 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-15885a09-7651-4dd1-81a8-a70de2312981 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:30.850678 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-15885a09-7651-4dd1-81a8-a70de2312981 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.148360 Jul 12 17:36:30.851233 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 509/994] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:30 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:30.981164 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b475d461-adc6-4975-b756-f41094a394b9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:30.981714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b475d461-adc6-4975-b756-f41094a394b9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:30.988082 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b475d461-adc6-4975-b756-f41094a394b9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:30.988526 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b475d461-adc6-4975-b756-f41094a394b9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:30.989279 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b475d461-adc6-4975-b756-f41094a394b9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:30.989734 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b475d461-adc6-4975-b756-f41094a394b9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:31.116193 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b475d461-adc6-4975-b756-f41094a394b9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:31.118527 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:36:31.125653 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b475d461-adc6-4975-b756-f41094a394b9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.148373 Jul 12 17:36:31.126238 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 486/995] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:30 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:31.500704 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e97cc373-83e8-4963-b315-dbde0cf8c88e tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:31.501352 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e97cc373-83e8-4963-b315-dbde0cf8c88e tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:31.507452 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e97cc373-83e8-4963-b315-dbde0cf8c88e tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:31.507887 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e97cc373-83e8-4963-b315-dbde0cf8c88e tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:31.508650 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e97cc373-83e8-4963-b315-dbde0cf8c88e tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:31.509090 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e97cc373-83e8-4963-b315-dbde0cf8c88e tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:31.571198 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e97cc373-83e8-4963-b315-dbde0cf8c88e tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:31.578439 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e97cc373-83e8-4963-b315-dbde0cf8c88e tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1222 microversion: 2.1 time: 0.082279 Jul 12 17:36:31.579026 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 510/996] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:31 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:31.869842 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d06b08e6-04cd-4928-adfc-a9063446cbdf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:31.870443 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d06b08e6-04cd-4928-adfc-a9063446cbdf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:31.877144 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d06b08e6-04cd-4928-adfc-a9063446cbdf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:31.877655 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d06b08e6-04cd-4928-adfc-a9063446cbdf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:31.878468 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d06b08e6-04cd-4928-adfc-a9063446cbdf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:31.878898 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d06b08e6-04cd-4928-adfc-a9063446cbdf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:32.004927 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d06b08e6-04cd-4928-adfc-a9063446cbdf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:32.013313 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d06b08e6-04cd-4928-adfc-a9063446cbdf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:32.014868 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d06b08e6-04cd-4928-adfc-a9063446cbdf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:32.016062 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d06b08e6-04cd-4928-adfc-a9063446cbdf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.150878 Jul 12 17:36:32.016616 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 487/997] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:31 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:32.142898 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a99192f6-0047-45c0-a54f-d30fe3140ce8 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:32.143586 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a99192f6-0047-45c0-a54f-d30fe3140ce8 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:32.150243 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a99192f6-0047-45c0-a54f-d30fe3140ce8 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:32.150686 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a99192f6-0047-45c0-a54f-d30fe3140ce8 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:32.151450 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a99192f6-0047-45c0-a54f-d30fe3140ce8 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:32.151881 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a99192f6-0047-45c0-a54f-d30fe3140ce8 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:32.287387 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a99192f6-0047-45c0-a54f-d30fe3140ce8 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:32.295527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a99192f6-0047-45c0-a54f-d30fe3140ce8 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.156535 Jul 12 17:36:32.296100 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 511/998] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:32 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:32.595416 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-69465c3c-0795-4c10-95a2-77a499c8052d tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:32.596035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-69465c3c-0795-4c10-95a2-77a499c8052d tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:32.598014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:36:32.604509 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-69465c3c-0795-4c10-95a2-77a499c8052d tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:32.604964 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-69465c3c-0795-4c10-95a2-77a499c8052d tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:32.606368 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-69465c3c-0795-4c10-95a2-77a499c8052d tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:32.606942 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-69465c3c-0795-4c10-95a2-77a499c8052d tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:32.671603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-69465c3c-0795-4c10-95a2-77a499c8052d tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:32.678940 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-69465c3c-0795-4c10-95a2-77a499c8052d tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1214 microversion: 2.1 time: 0.087428 Jul 12 17:36:32.679608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 488/999] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:32 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:33.034040 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4a7deaec-34e1-40b4-a150-eb24221b1262 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:33.034575 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4a7deaec-34e1-40b4-a150-eb24221b1262 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:33.040569 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a7deaec-34e1-40b4-a150-eb24221b1262 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:33.041016 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a7deaec-34e1-40b4-a150-eb24221b1262 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:33.041823 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a7deaec-34e1-40b4-a150-eb24221b1262 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:33.042261 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4a7deaec-34e1-40b4-a150-eb24221b1262 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:33.046139 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:36:33.168094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4a7deaec-34e1-40b4-a150-eb24221b1262 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:33.175898 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4a7deaec-34e1-40b4-a150-eb24221b1262 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:33.177405 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4a7deaec-34e1-40b4-a150-eb24221b1262 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:33.178587 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4a7deaec-34e1-40b4-a150-eb24221b1262 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.148556 Jul 12 17:36:33.179152 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 512/1000] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:33 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:33.312733 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9e8f6f93-014f-4539-a8ce-fa14197a8a8b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:33.313374 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9e8f6f93-014f-4539-a8ce-fa14197a8a8b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:33.319773 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9e8f6f93-014f-4539-a8ce-fa14197a8a8b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:33.320226 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9e8f6f93-014f-4539-a8ce-fa14197a8a8b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:33.320993 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9e8f6f93-014f-4539-a8ce-fa14197a8a8b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:33.321434 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9e8f6f93-014f-4539-a8ce-fa14197a8a8b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:33.449737 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9e8f6f93-014f-4539-a8ce-fa14197a8a8b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:33.457116 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9e8f6f93-014f-4539-a8ce-fa14197a8a8b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.148771 Jul 12 17:36:33.457680 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 489/1001] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:33 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:33.696035 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cafe0331-ffea-4e1b-9eed-0752bd1b6856 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:33.696581 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cafe0331-ffea-4e1b-9eed-0752bd1b6856 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:33.703108 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cafe0331-ffea-4e1b-9eed-0752bd1b6856 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:33.703561 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cafe0331-ffea-4e1b-9eed-0752bd1b6856 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:33.704321 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cafe0331-ffea-4e1b-9eed-0752bd1b6856 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:33.704764 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cafe0331-ffea-4e1b-9eed-0752bd1b6856 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:33.767172 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cafe0331-ffea-4e1b-9eed-0752bd1b6856 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:33.774613 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cafe0331-ffea-4e1b-9eed-0752bd1b6856 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1214 microversion: 2.1 time: 0.082487 Jul 12 17:36:33.775180 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 513/1002] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:33 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:34.196543 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-33cc8321-9632-42d6-abdc-d7d417bd776b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:34.197143 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-33cc8321-9632-42d6-abdc-d7d417bd776b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:34.203569 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-33cc8321-9632-42d6-abdc-d7d417bd776b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:34.204010 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-33cc8321-9632-42d6-abdc-d7d417bd776b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:34.204771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-33cc8321-9632-42d6-abdc-d7d417bd776b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:34.205201 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-33cc8321-9632-42d6-abdc-d7d417bd776b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:34.334742 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-33cc8321-9632-42d6-abdc-d7d417bd776b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:34.355162 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-33cc8321-9632-42d6-abdc-d7d417bd776b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:34.358736 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-33cc8321-9632-42d6-abdc-d7d417bd776b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:34.361719 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-33cc8321-9632-42d6-abdc-d7d417bd776b tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.168205 Jul 12 17:36:34.364179 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 490/1003] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:34 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:34.474515 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5f95c355-0d00-4dde-b8fa-8bba8d696126 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:34.475055 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5f95c355-0d00-4dde-b8fa-8bba8d696126 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:34.481973 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5f95c355-0d00-4dde-b8fa-8bba8d696126 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:34.482416 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5f95c355-0d00-4dde-b8fa-8bba8d696126 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:34.483166 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5f95c355-0d00-4dde-b8fa-8bba8d696126 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:34.483595 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5f95c355-0d00-4dde-b8fa-8bba8d696126 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:34.616221 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5f95c355-0d00-4dde-b8fa-8bba8d696126 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:34.626572 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5f95c355-0d00-4dde-b8fa-8bba8d696126 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.155784 Jul 12 17:36:34.627149 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 514/1004] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:34 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:34.791881 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5f3e2368-3cf1-45a2-a705-491f9ba227c9 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:34.793149 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5f3e2368-3cf1-45a2-a705-491f9ba227c9 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:34.799183 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5f3e2368-3cf1-45a2-a705-491f9ba227c9 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:34.799637 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5f3e2368-3cf1-45a2-a705-491f9ba227c9 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:34.800401 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5f3e2368-3cf1-45a2-a705-491f9ba227c9 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:34.800839 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5f3e2368-3cf1-45a2-a705-491f9ba227c9 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:34.864245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5f3e2368-3cf1-45a2-a705-491f9ba227c9 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:34.871606 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5f3e2368-3cf1-45a2-a705-491f9ba227c9 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1270 microversion: 2.1 time: 0.083673 Jul 12 17:36:34.872166 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 491/1005] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:34 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:35.380618 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f366a53f-f661-42b9-a97f-b7b4713b58ed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:35.381132 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f366a53f-f661-42b9-a97f-b7b4713b58ed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:35.386966 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f366a53f-f661-42b9-a97f-b7b4713b58ed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:35.387414 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f366a53f-f661-42b9-a97f-b7b4713b58ed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:35.388172 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f366a53f-f661-42b9-a97f-b7b4713b58ed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:35.389056 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f366a53f-f661-42b9-a97f-b7b4713b58ed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:35.614944 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f366a53f-f661-42b9-a97f-b7b4713b58ed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:35.623117 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f366a53f-f661-42b9-a97f-b7b4713b58ed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:35.624627 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f366a53f-f661-42b9-a97f-b7b4713b58ed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:35.625848 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f366a53f-f661-42b9-a97f-b7b4713b58ed tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.249144 Jul 12 17:36:35.626412 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 515/1006] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:35 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:36:35.643465 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c94c1c92-7435-4759-bc40-af2a624baa29 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:35.643995 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c94c1c92-7435-4759-bc40-af2a624baa29 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:35.650402 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c94c1c92-7435-4759-bc40-af2a624baa29 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:35.650846 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c94c1c92-7435-4759-bc40-af2a624baa29 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:35.651611 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c94c1c92-7435-4759-bc40-af2a624baa29 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:35.652579 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c94c1c92-7435-4759-bc40-af2a624baa29 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:35.858578 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c94c1c92-7435-4759-bc40-af2a624baa29 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:35.866160 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c94c1c92-7435-4759-bc40-af2a624baa29 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.226546 Jul 12 17:36:35.866725 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 492/1007] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:35 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:35.888564 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5b35e03b-fb33-4c92-a409-f7f4bc8b3f61 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:35.889168 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5b35e03b-fb33-4c92-a409-f7f4bc8b3f61 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:35.895326 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5b35e03b-fb33-4c92-a409-f7f4bc8b3f61 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:35.895709 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5b35e03b-fb33-4c92-a409-f7f4bc8b3f61 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:35.896463 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5b35e03b-fb33-4c92-a409-f7f4bc8b3f61 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:35.896891 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5b35e03b-fb33-4c92-a409-f7f4bc8b3f61 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:36.127146 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5b35e03b-fb33-4c92-a409-f7f4bc8b3f61 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:36.134744 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5b35e03b-fb33-4c92-a409-f7f4bc8b3f61 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1318 microversion: 2.1 time: 0.250512 Jul 12 17:36:36.135525 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 516/1008] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:35 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:36.516348 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-ef0229ea-5468-4e45-9082-9be2db29219a req-df28dadb-592c-4235-ab5f-0ad21dc82ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc", "tag": "2c4d18f3-2927-4e38-8f30-cd7cb5755c6e"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:36:36.524453 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-ef0229ea-5468-4e45-9082-9be2db29219a req-df28dadb-592c-4235-ab5f-0ad21dc82ea3 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:36.524903 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-ef0229ea-5468-4e45-9082-9be2db29219a req-df28dadb-592c-4235-ab5f-0ad21dc82ea3 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:36.537869 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-ef0229ea-5468-4e45-9082-9be2db29219a req-df28dadb-592c-4235-ab5f-0ad21dc82ea3 service nova] Creating event network-changed:2c4d18f3-2927-4e38-8f30-cd7cb5755c6e for instance 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc on hv-cinder-84932 Jul 12 17:36:36.542601 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-ef0229ea-5468-4e45-9082-9be2db29219a req-df28dadb-592c-4235-ab5f-0ad21dc82ea3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029942 Jul 12 17:36:36.543228 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 493/1009] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:36:36.643742 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-55c8b99f-8ede-428c-b6e9-b85d6aa78171 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:36.644348 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-55c8b99f-8ede-428c-b6e9-b85d6aa78171 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:36.650861 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-55c8b99f-8ede-428c-b6e9-b85d6aa78171 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:36.651300 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-55c8b99f-8ede-428c-b6e9-b85d6aa78171 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:36.652587 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-55c8b99f-8ede-428c-b6e9-b85d6aa78171 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:36.653017 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-55c8b99f-8ede-428c-b6e9-b85d6aa78171 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:36.884633 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-220f5119-3765-4654-bb18-c041aca1ecdd tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:36.885362 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-220f5119-3765-4654-bb18-c041aca1ecdd tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:36.893499 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-220f5119-3765-4654-bb18-c041aca1ecdd tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:36.893973 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-220f5119-3765-4654-bb18-c041aca1ecdd tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:36.895020 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-220f5119-3765-4654-bb18-c041aca1ecdd tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:36.895478 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-220f5119-3765-4654-bb18-c041aca1ecdd tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:36.993644 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:36:37.015894 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=6 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:36:37.158959 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:36:37.218427 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-55c8b99f-8ede-428c-b6e9-b85d6aa78171 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:37.226258 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-55c8b99f-8ede-428c-b6e9-b85d6aa78171 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:37.227751 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-55c8b99f-8ede-428c-b6e9-b85d6aa78171 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:37.228903 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-55c8b99f-8ede-428c-b6e9-b85d6aa78171 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.589076 Jul 12 17:36:37.229462 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 517/1010] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:36 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:37.235268 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-dde66e91-42c0-41a2-8b3e-4f6ade179ca5 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:37.235876 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-dde66e91-42c0-41a2-8b3e-4f6ade179ca5 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:37.241093 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-220f5119-3765-4654-bb18-c041aca1ecdd tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:37.241960 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dde66e91-42c0-41a2-8b3e-4f6ade179ca5 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:37.242541 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dde66e91-42c0-41a2-8b3e-4f6ade179ca5 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:37.243340 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dde66e91-42c0-41a2-8b3e-4f6ade179ca5 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:37.243798 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dde66e91-42c0-41a2-8b3e-4f6ade179ca5 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:37.249720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-220f5119-3765-4654-bb18-c041aca1ecdd tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.370333 Jul 12 17:36:37.250914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 494/1011] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:36 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:37.428798 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-dde66e91-42c0-41a2-8b3e-4f6ade179ca5 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:37.436081 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-dde66e91-42c0-41a2-8b3e-4f6ade179ca5 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1318 microversion: 2.1 time: 0.205582 Jul 12 17:36:37.436638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 518/1012] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:37 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:38.246068 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-96259642-6b6e-4b48-a0cb-253bdc80f434 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:38.246680 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-96259642-6b6e-4b48-a0cb-253bdc80f434 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:38.253068 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-96259642-6b6e-4b48-a0cb-253bdc80f434 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:38.253516 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-96259642-6b6e-4b48-a0cb-253bdc80f434 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:38.254463 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-96259642-6b6e-4b48-a0cb-253bdc80f434 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:38.254898 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-96259642-6b6e-4b48-a0cb-253bdc80f434 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:38.267043 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bbb98e24-d28d-4ddb-833d-dc52387360fe tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:38.267659 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bbb98e24-d28d-4ddb-833d-dc52387360fe tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:38.274292 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bbb98e24-d28d-4ddb-833d-dc52387360fe tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:38.274736 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bbb98e24-d28d-4ddb-833d-dc52387360fe tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:38.275500 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bbb98e24-d28d-4ddb-833d-dc52387360fe tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:38.275935 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bbb98e24-d28d-4ddb-833d-dc52387360fe tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:38.452298 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-96259642-6b6e-4b48-a0cb-253bdc80f434 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:38.460320 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-96259642-6b6e-4b48-a0cb-253bdc80f434 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:38.462535 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-96259642-6b6e-4b48-a0cb-253bdc80f434 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:38.463715 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-96259642-6b6e-4b48-a0cb-253bdc80f434 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.221647 Jul 12 17:36:38.464271 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 495/1013] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:38 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:38.473067 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-bbb98e24-d28d-4ddb-833d-dc52387360fe tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:38.473227 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-bbbc5056-a297-44a5-a16f-cc215cf0d491 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:38.473227 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-bbbc5056-a297-44a5-a16f-cc215cf0d491 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:38.473402 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bbb98e24-d28d-4ddb-833d-dc52387360fe tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.208980 Jul 12 17:36:38.473402 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 519/1014] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:38 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:38.475840 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bbbc5056-a297-44a5-a16f-cc215cf0d491 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:38.476282 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bbbc5056-a297-44a5-a16f-cc215cf0d491 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:38.477045 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bbbc5056-a297-44a5-a16f-cc215cf0d491 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:38.477477 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bbbc5056-a297-44a5-a16f-cc215cf0d491 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:38.608455 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-bbbc5056-a297-44a5-a16f-cc215cf0d491 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:38.615803 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-bbbc5056-a297-44a5-a16f-cc215cf0d491 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1318 microversion: 2.1 time: 0.150538 Jul 12 17:36:38.616311 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 496/1015] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:38 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:39.482642 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a6223622-4132-4692-a634-66e9801a5ea2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:39.483212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a6223622-4132-4692-a634-66e9801a5ea2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:39.488749 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-154e98e0-93af-4edb-a0d1-aba00485d123 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:39.489364 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-154e98e0-93af-4edb-a0d1-aba00485d123 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:39.489654 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a6223622-4132-4692-a634-66e9801a5ea2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:39.490137 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a6223622-4132-4692-a634-66e9801a5ea2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:39.490904 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a6223622-4132-4692-a634-66e9801a5ea2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:39.491341 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a6223622-4132-4692-a634-66e9801a5ea2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:39.496431 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-154e98e0-93af-4edb-a0d1-aba00485d123 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:39.496876 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-154e98e0-93af-4edb-a0d1-aba00485d123 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:39.498020 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-154e98e0-93af-4edb-a0d1-aba00485d123 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:39.498460 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-154e98e0-93af-4edb-a0d1-aba00485d123 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:39.682560 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a6223622-4132-4692-a634-66e9801a5ea2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:39.690770 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a6223622-4132-4692-a634-66e9801a5ea2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:39.691120 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-154e98e0-93af-4edb-a0d1-aba00485d123 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:39.692358 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a6223622-4132-4692-a634-66e9801a5ea2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:39.693513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a6223622-4132-4692-a634-66e9801a5ea2 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.215451 Jul 12 17:36:39.694095 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 520/1016] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:39 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:39.699160 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-154e98e0-93af-4edb-a0d1-aba00485d123 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.213755 Jul 12 17:36:39.699359 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-232182a1-0ed5-4497-b8de-77fa776963c5 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:39.699842 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 497/1017] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:39 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:39.699973 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-232182a1-0ed5-4497-b8de-77fa776963c5 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:39.705769 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-232182a1-0ed5-4497-b8de-77fa776963c5 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:39.706221 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-232182a1-0ed5-4497-b8de-77fa776963c5 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:39.706980 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-232182a1-0ed5-4497-b8de-77fa776963c5 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:39.707415 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-232182a1-0ed5-4497-b8de-77fa776963c5 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:39.836655 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-232182a1-0ed5-4497-b8de-77fa776963c5 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:39.844002 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-232182a1-0ed5-4497-b8de-77fa776963c5 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1318 microversion: 2.1 time: 0.148797 Jul 12 17:36:39.844563 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 521/1018] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:39 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:40.712053 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2c340756-ee33-4fe1-bded-30da647e9b42 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:40.712661 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2c340756-ee33-4fe1-bded-30da647e9b42 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:40.716087 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c8492c9c-2413-431a-97e9-b9388e7028d2 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:40.716496 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c8492c9c-2413-431a-97e9-b9388e7028d2 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:40.719121 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c340756-ee33-4fe1-bded-30da647e9b42 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:40.719567 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c340756-ee33-4fe1-bded-30da647e9b42 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:40.720331 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c340756-ee33-4fe1-bded-30da647e9b42 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:40.720760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c340756-ee33-4fe1-bded-30da647e9b42 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:40.722558 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c8492c9c-2413-431a-97e9-b9388e7028d2 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:40.723012 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c8492c9c-2413-431a-97e9-b9388e7028d2 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:40.723767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c8492c9c-2413-431a-97e9-b9388e7028d2 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:40.724229 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c8492c9c-2413-431a-97e9-b9388e7028d2 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:40.914260 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2c340756-ee33-4fe1-bded-30da647e9b42 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:40.918216 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c8492c9c-2413-431a-97e9-b9388e7028d2 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:40.922843 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2c340756-ee33-4fe1-bded-30da647e9b42 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:40.924350 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2c340756-ee33-4fe1-bded-30da647e9b42 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:40.925559 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2c340756-ee33-4fe1-bded-30da647e9b42 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.217519 Jul 12 17:36:40.925718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c8492c9c-2413-431a-97e9-b9388e7028d2 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.213893 Jul 12 17:36:40.926153 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 498/1019] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:40 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:36:40.927233 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 522/1020] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:40 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:40.938483 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d6ef6405-6fa0-47e7-a4b9-8c380069f964 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:40.939124 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d6ef6405-6fa0-47e7-a4b9-8c380069f964 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:40.945243 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d6ef6405-6fa0-47e7-a4b9-8c380069f964 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:40.945743 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d6ef6405-6fa0-47e7-a4b9-8c380069f964 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:40.946506 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d6ef6405-6fa0-47e7-a4b9-8c380069f964 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:40.946933 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d6ef6405-6fa0-47e7-a4b9-8c380069f964 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:41.067769 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c064330c-4163-48f2-8032-768bd7f4744d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:41.068264 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c064330c-4163-48f2-8032-768bd7f4744d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:41.074213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c064330c-4163-48f2-8032-768bd7f4744d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:41.074661 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c064330c-4163-48f2-8032-768bd7f4744d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:41.075426 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c064330c-4163-48f2-8032-768bd7f4744d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:41.075859 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c064330c-4163-48f2-8032-768bd7f4744d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:41.077719 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d6ef6405-6fa0-47e7-a4b9-8c380069f964 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:41.084999 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d6ef6405-6fa0-47e7-a4b9-8c380069f964 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1318 microversion: 2.1 time: 0.157909 Jul 12 17:36:41.085558 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 499/1021] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:40 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:41.098716 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c064330c-4163-48f2-8032-768bd7f4744d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/ips" status: 200 len: 150 microversion: 2.1 time: 0.170319 Jul 12 17:36:41.099256 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 523/1022] 10.222.0.62 () {58 vars in 1247 bytes} [Tue Jul 12 17:36:40 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/ips => generated 150 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:36:41.943571 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5619523a-8179-47ef-b703-c5e095db94ac tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:41.944186 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5619523a-8179-47ef-b703-c5e095db94ac tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:41.944307 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-df39e167-9e02-4051-a43e-949a4c617a94 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:41.944906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-df39e167-9e02-4051-a43e-949a4c617a94 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:41.950827 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5619523a-8179-47ef-b703-c5e095db94ac tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:41.951275 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5619523a-8179-47ef-b703-c5e095db94ac tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:41.951420 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-df39e167-9e02-4051-a43e-949a4c617a94 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:41.951725 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-df39e167-9e02-4051-a43e-949a4c617a94 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:41.952037 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5619523a-8179-47ef-b703-c5e095db94ac tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:41.952467 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5619523a-8179-47ef-b703-c5e095db94ac tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:41.952569 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-df39e167-9e02-4051-a43e-949a4c617a94 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:41.952898 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-df39e167-9e02-4051-a43e-949a4c617a94 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:42.147529 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-df39e167-9e02-4051-a43e-949a4c617a94 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:42.152974 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5619523a-8179-47ef-b703-c5e095db94ac tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:42.156151 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-df39e167-9e02-4051-a43e-949a4c617a94 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:42.157657 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-df39e167-9e02-4051-a43e-949a4c617a94 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:42.158832 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-df39e167-9e02-4051-a43e-949a4c617a94 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.218349 Jul 12 17:36:42.159390 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 524/1023] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:41 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:36:42.160496 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5619523a-8179-47ef-b703-c5e095db94ac tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.221022 Jul 12 17:36:42.161160 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 500/1024] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:41 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:42.163735 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-79d59c34-cb0f-4711-8872-a87be76b5d5e tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:42.164340 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-79d59c34-cb0f-4711-8872-a87be76b5d5e tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:42.170685 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-79d59c34-cb0f-4711-8872-a87be76b5d5e tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:42.171131 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-79d59c34-cb0f-4711-8872-a87be76b5d5e tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:42.171889 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-79d59c34-cb0f-4711-8872-a87be76b5d5e tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:42.172327 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-79d59c34-cb0f-4711-8872-a87be76b5d5e tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:42.298859 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-79d59c34-cb0f-4711-8872-a87be76b5d5e tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:42.306096 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-79d59c34-cb0f-4711-8872-a87be76b5d5e tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1318 microversion: 2.1 time: 0.145735 Jul 12 17:36:42.306682 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 525/1025] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:42 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:43.177253 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-007738d1-6710-4162-9540-7f379624ad5a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:43.177862 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-44d19baa-1128-4bfd-a286-5567994e65e5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:43.178246 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-007738d1-6710-4162-9540-7f379624ad5a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:43.178356 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-44d19baa-1128-4bfd-a286-5567994e65e5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:43.184487 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-007738d1-6710-4162-9540-7f379624ad5a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:43.184722 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-44d19baa-1128-4bfd-a286-5567994e65e5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:43.184933 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-007738d1-6710-4162-9540-7f379624ad5a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:43.185177 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-44d19baa-1128-4bfd-a286-5567994e65e5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:43.185724 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-007738d1-6710-4162-9540-7f379624ad5a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:43.186072 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-44d19baa-1128-4bfd-a286-5567994e65e5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:43.186176 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-007738d1-6710-4162-9540-7f379624ad5a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:43.186514 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-44d19baa-1128-4bfd-a286-5567994e65e5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:43.379078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-44d19baa-1128-4bfd-a286-5567994e65e5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:43.387252 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-44d19baa-1128-4bfd-a286-5567994e65e5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.213190 Jul 12 17:36:43.388145 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 526/1026] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:43 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:43.393576 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-007738d1-6710-4162-9540-7f379624ad5a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:43.401510 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-007738d1-6710-4162-9540-7f379624ad5a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:43.403233 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-60e53f99-5d91-4ffe-8e1b-8b6be05bcd8f tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:43.403330 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-007738d1-6710-4162-9540-7f379624ad5a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:43.403648 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-60e53f99-5d91-4ffe-8e1b-8b6be05bcd8f tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:43.404209 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-007738d1-6710-4162-9540-7f379624ad5a tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.230924 Jul 12 17:36:43.404761 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 501/1027] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:43 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:43.410051 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-60e53f99-5d91-4ffe-8e1b-8b6be05bcd8f tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:43.410524 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-60e53f99-5d91-4ffe-8e1b-8b6be05bcd8f tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:43.411278 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-60e53f99-5d91-4ffe-8e1b-8b6be05bcd8f tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:43.411717 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-60e53f99-5d91-4ffe-8e1b-8b6be05bcd8f tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:43.457706 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-863d0408-527d-4242-94ec-6d2ccc25c676 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85218626-ae8d-41e6-9c02-af5f572ba3dc"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:36:43.458882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-863d0408-527d-4242-94ec-6d2ccc25c676 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:43.466646 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-863d0408-527d-4242-94ec-6d2ccc25c676 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:43.467615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-863d0408-527d-4242-94ec-6d2ccc25c676 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:43.469220 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-863d0408-527d-4242-94ec-6d2ccc25c676 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:43.469739 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-863d0408-527d-4242-94ec-6d2ccc25c676 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:43.558311 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-60e53f99-5d91-4ffe-8e1b-8b6be05bcd8f tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:43.565927 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-60e53f99-5d91-4ffe-8e1b-8b6be05bcd8f tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1318 microversion: 2.1 time: 0.167235 Jul 12 17:36:43.566493 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 527/1028] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:43 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:44.404584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4ac13eea-b42a-4929-bd8b-b3ac8198e230 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:44.405248 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4ac13eea-b42a-4929-bd8b-b3ac8198e230 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:44.412258 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ac13eea-b42a-4929-bd8b-b3ac8198e230 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:44.412698 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ac13eea-b42a-4929-bd8b-b3ac8198e230 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:44.413451 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ac13eea-b42a-4929-bd8b-b3ac8198e230 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:44.413913 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ac13eea-b42a-4929-bd8b-b3ac8198e230 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:44.542233 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4ac13eea-b42a-4929-bd8b-b3ac8198e230 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:44.550410 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4ac13eea-b42a-4929-bd8b-b3ac8198e230 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.150235 Jul 12 17:36:44.550976 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 528/1029] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:44 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:44.555290 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e3dd72f7-9900-4c26-9a81-44a5f6cc3116 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:44.555888 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e3dd72f7-9900-4c26-9a81-44a5f6cc3116 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:44.561331 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e3dd72f7-9900-4c26-9a81-44a5f6cc3116 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:44.561809 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e3dd72f7-9900-4c26-9a81-44a5f6cc3116 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:44.562569 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e3dd72f7-9900-4c26-9a81-44a5f6cc3116 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:44.563004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e3dd72f7-9900-4c26-9a81-44a5f6cc3116 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:44.567090 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:36:44.700903 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e3dd72f7-9900-4c26-9a81-44a5f6cc3116 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:44.710656 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e3dd72f7-9900-4c26-9a81-44a5f6cc3116 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:44.712561 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e3dd72f7-9900-4c26-9a81-44a5f6cc3116 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:44.713762 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e3dd72f7-9900-4c26-9a81-44a5f6cc3116 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.161847 Jul 12 17:36:44.715023 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 529/1030] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:44 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:44.729216 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-951d9453-358f-4db5-9755-67d7d29c7827 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:44.729858 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-951d9453-358f-4db5-9755-67d7d29c7827 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:44.736388 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-951d9453-358f-4db5-9755-67d7d29c7827 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:44.736834 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-951d9453-358f-4db5-9755-67d7d29c7827 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:44.737626 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-951d9453-358f-4db5-9755-67d7d29c7827 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:44.738084 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-951d9453-358f-4db5-9755-67d7d29c7827 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:44.871380 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-951d9453-358f-4db5-9755-67d7d29c7827 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:44.879201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-951d9453-358f-4db5-9755-67d7d29c7827 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1318 microversion: 2.1 time: 0.163834 Jul 12 17:36:44.879791 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 530/1031] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:44 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:45.073660 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-6de79a05-f554-4277-b380-9b1317b6e3d6 req-b08dd16f-1b4a-45b1-aca6-4ce5affbc099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeedc087-222c-4452-bf37-2f152ce787a6", "name": "network-vif-plugged", "status": "completed", "tag": "c8a34f14-81f6-401c-83f7-ce051f443de8"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:36:45.082330 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-6de79a05-f554-4277-b380-9b1317b6e3d6 req-b08dd16f-1b4a-45b1-aca6-4ce5affbc099 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:45.082777 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-6de79a05-f554-4277-b380-9b1317b6e3d6 req-b08dd16f-1b4a-45b1-aca6-4ce5affbc099 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:45.093578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-6de79a05-f554-4277-b380-9b1317b6e3d6 req-b08dd16f-1b4a-45b1-aca6-4ce5affbc099 service nova] Creating event network-vif-plugged:c8a34f14-81f6-401c-83f7-ce051f443de8 for instance aeedc087-222c-4452-bf37-2f152ce787a6 on hv-cinder-84932 Jul 12 17:36:45.099537 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-6de79a05-f554-4277-b380-9b1317b6e3d6 req-b08dd16f-1b4a-45b1-aca6-4ce5affbc099 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087629 Jul 12 17:36:45.100531 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 531/1032] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:36:45.568639 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5e3fa238-5749-4dd4-9af0-8e04a1b8511e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:45.570198 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5e3fa238-5749-4dd4-9af0-8e04a1b8511e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:45.576445 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5e3fa238-5749-4dd4-9af0-8e04a1b8511e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:45.576893 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5e3fa238-5749-4dd4-9af0-8e04a1b8511e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:45.577659 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5e3fa238-5749-4dd4-9af0-8e04a1b8511e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:45.578117 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5e3fa238-5749-4dd4-9af0-8e04a1b8511e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:45.807726 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:36:45.821288 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-863d0408-527d-4242-94ec-6d2ccc25c676 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "POST /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.367512 Jul 12 17:36:45.821978 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 502/1033] 10.222.0.62 () {60 vars in 1322 bytes} [Tue Jul 12 17:36:43 2022] POST /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments => generated 194 bytes in 2369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:36:45.831646 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-22fb9086-5814-433f-8beb-6ebaa475209e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:45.832778 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-22fb9086-5814-433f-8beb-6ebaa475209e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:45.841619 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-22fb9086-5814-433f-8beb-6ebaa475209e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:45.842467 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-22fb9086-5814-433f-8beb-6ebaa475209e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:45.843575 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-22fb9086-5814-433f-8beb-6ebaa475209e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:45.844208 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-22fb9086-5814-433f-8beb-6ebaa475209e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:45.852141 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5e3fa238-5749-4dd4-9af0-8e04a1b8511e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:45.868414 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5e3fa238-5749-4dd4-9af0-8e04a1b8511e tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.300997 Jul 12 17:36:45.871934 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 532/1034] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:45 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:45.896269 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-aa378fda-bf41-4910-9a5f-a8f5106ff04a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:45.896873 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-aa378fda-bf41-4910-9a5f-a8f5106ff04a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:45.902918 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aa378fda-bf41-4910-9a5f-a8f5106ff04a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:45.903361 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aa378fda-bf41-4910-9a5f-a8f5106ff04a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:45.904125 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aa378fda-bf41-4910-9a5f-a8f5106ff04a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:45.904555 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aa378fda-bf41-4910-9a5f-a8f5106ff04a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:46.044550 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-22fb9086-5814-433f-8beb-6ebaa475209e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:46.052632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-22fb9086-5814-433f-8beb-6ebaa475209e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:46.054206 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-22fb9086-5814-433f-8beb-6ebaa475209e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:46.055372 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-22fb9086-5814-433f-8beb-6ebaa475209e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.231893 Jul 12 17:36:46.055936 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 503/1035] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:45 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:46.066937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-aa378fda-bf41-4910-9a5f-a8f5106ff04a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:46.074430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-aa378fda-bf41-4910-9a5f-a8f5106ff04a tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1318 microversion: 2.1 time: 0.181971 Jul 12 17:36:46.075489 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 533/1036] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:45 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:46.887593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-db840e76-930d-445b-81ea-06c0158b8b34 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:46.888199 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-db840e76-930d-445b-81ea-06c0158b8b34 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:46.894729 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-db840e76-930d-445b-81ea-06c0158b8b34 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:46.895178 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-db840e76-930d-445b-81ea-06c0158b8b34 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:46.895943 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-db840e76-930d-445b-81ea-06c0158b8b34 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:46.896378 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-db840e76-930d-445b-81ea-06c0158b8b34 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:47.031150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-db840e76-930d-445b-81ea-06c0158b8b34 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:47.038649 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-db840e76-930d-445b-81ea-06c0158b8b34 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.155347 Jul 12 17:36:47.039216 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 504/1037] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:46 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:47.073643 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-387582ad-4fc5-4119-afcd-025d259c36d9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:47.074909 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-387582ad-4fc5-4119-afcd-025d259c36d9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:47.081353 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-387582ad-4fc5-4119-afcd-025d259c36d9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:47.081840 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-387582ad-4fc5-4119-afcd-025d259c36d9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:47.082598 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-387582ad-4fc5-4119-afcd-025d259c36d9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:47.083053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-387582ad-4fc5-4119-afcd-025d259c36d9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:47.092738 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f0a77c9d-66a0-4e95-9bdd-9034b72be110 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:47.093637 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f0a77c9d-66a0-4e95-9bdd-9034b72be110 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:47.100729 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f0a77c9d-66a0-4e95-9bdd-9034b72be110 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:47.101632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f0a77c9d-66a0-4e95-9bdd-9034b72be110 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:47.103063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f0a77c9d-66a0-4e95-9bdd-9034b72be110 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:47.103696 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f0a77c9d-66a0-4e95-9bdd-9034b72be110 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:47.285306 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-387582ad-4fc5-4119-afcd-025d259c36d9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:47.289355 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f0a77c9d-66a0-4e95-9bdd-9034b72be110 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:47.293491 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-387582ad-4fc5-4119-afcd-025d259c36d9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:47.295051 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-387582ad-4fc5-4119-afcd-025d259c36d9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:47.296210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-387582ad-4fc5-4119-afcd-025d259c36d9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.226493 Jul 12 17:36:47.296571 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f0a77c9d-66a0-4e95-9bdd-9034b72be110 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1318 microversion: 2.1 time: 0.208921 Jul 12 17:36:47.296771 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 534/1038] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:47 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:47.297892 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 505/1039] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:47 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:47.301138 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-403c08f3-78a5-4a60-a8da-7bceab8c7994 req-0a07665d-38b5-407c-98dc-45928d68a874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc", "name": "network-vif-plugged", "status": "completed", "tag": "2c4d18f3-2927-4e38-8f30-cd7cb5755c6e"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:36:47.309388 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-403c08f3-78a5-4a60-a8da-7bceab8c7994 req-0a07665d-38b5-407c-98dc-45928d68a874 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:47.309868 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-403c08f3-78a5-4a60-a8da-7bceab8c7994 req-0a07665d-38b5-407c-98dc-45928d68a874 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:47.320513 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-403c08f3-78a5-4a60-a8da-7bceab8c7994 req-0a07665d-38b5-407c-98dc-45928d68a874 service nova] Creating event network-vif-plugged:2c4d18f3-2927-4e38-8f30-cd7cb5755c6e for instance 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc on hv-cinder-84932 Jul 12 17:36:47.326077 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-403c08f3-78a5-4a60-a8da-7bceab8c7994 req-0a07665d-38b5-407c-98dc-45928d68a874 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028174 Jul 12 17:36:47.326640 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 535/1040] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:36:48.055645 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-151065d6-c585-4f6d-82a9-2ec705515382 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:48.056283 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-151065d6-c585-4f6d-82a9-2ec705515382 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:48.062661 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-151065d6-c585-4f6d-82a9-2ec705515382 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:48.063102 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-151065d6-c585-4f6d-82a9-2ec705515382 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:48.063856 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-151065d6-c585-4f6d-82a9-2ec705515382 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:48.064287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-151065d6-c585-4f6d-82a9-2ec705515382 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:48.197590 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-151065d6-c585-4f6d-82a9-2ec705515382 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:48.204959 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-151065d6-c585-4f6d-82a9-2ec705515382 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.153169 Jul 12 17:36:48.205524 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 506/1041] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:48 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:48.314664 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-17c2b762-afa0-471c-9759-a7026e784d72 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:48.315317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3782cfb6-8a6b-46f1-883a-c91847dac544 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:48.315770 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-17c2b762-afa0-471c-9759-a7026e784d72 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:48.316049 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3782cfb6-8a6b-46f1-883a-c91847dac544 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:48.321366 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-17c2b762-afa0-471c-9759-a7026e784d72 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:48.321853 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-17c2b762-afa0-471c-9759-a7026e784d72 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:48.322116 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3782cfb6-8a6b-46f1-883a-c91847dac544 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:48.322563 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3782cfb6-8a6b-46f1-883a-c91847dac544 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:48.322677 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-17c2b762-afa0-471c-9759-a7026e784d72 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:48.323033 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-17c2b762-afa0-471c-9759-a7026e784d72 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:48.323317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3782cfb6-8a6b-46f1-883a-c91847dac544 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:48.323753 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3782cfb6-8a6b-46f1-883a-c91847dac544 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:48.513856 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3782cfb6-8a6b-46f1-883a-c91847dac544 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:48.516504 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-17c2b762-afa0-471c-9759-a7026e784d72 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:48.521404 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3782cfb6-8a6b-46f1-883a-c91847dac544 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1318 microversion: 2.1 time: 0.210886 Jul 12 17:36:48.522036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 536/1042] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:48 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:48.524554 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-17c2b762-afa0-471c-9759-a7026e784d72 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:48.526094 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-17c2b762-afa0-471c-9759-a7026e784d72 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:48.527252 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-17c2b762-afa0-471c-9759-a7026e784d72 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1730 microversion: 2.20 time: 0.216664 Jul 12 17:36:48.528387 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 507/1043] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:48 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1730 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 17:36:49.055120 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cf0f6dd0-b37e-4a77-84fd-87c9d6247f42 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1496280867", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1098037494", "security_groups": [{"name": "tempest-secgroup-smoke-538136482"}], "block_device_mapping_v2": [{"uuid": "46631603-8b4e-405d-aa90-eb3c34ec0f9e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "669116b9-7a59-4591-9422-ba3889789c63"}]}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:36:49.160683 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-cf0f6dd0-b37e-4a77-84fd-87c9d6247f42 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] validate_networks() for [('669116b9-7a59-4591-9422-ba3889789c63', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:36:49.222028 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-eff7eec5-943c-4a7e-9c97-c3156b0d97e2 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:49.223389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-eff7eec5-943c-4a7e-9c97-c3156b0d97e2 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:49.230059 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eff7eec5-943c-4a7e-9c97-c3156b0d97e2 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:49.231220 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eff7eec5-943c-4a7e-9c97-c3156b0d97e2 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:49.232143 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eff7eec5-943c-4a7e-9c97-c3156b0d97e2 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:49.232756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eff7eec5-943c-4a7e-9c97-c3156b0d97e2 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:49.419647 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-eff7eec5-943c-4a7e-9c97-c3156b0d97e2 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:49.427464 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-eff7eec5-943c-4a7e-9c97-c3156b0d97e2 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.209424 Jul 12 17:36:49.428063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 508/1044] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:49 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:49.537965 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e726ff1b-819e-4e20-b9a4-0e37a8a92a10 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:49.538574 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e726ff1b-819e-4e20-b9a4-0e37a8a92a10 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:49.545408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e726ff1b-819e-4e20-b9a4-0e37a8a92a10 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:49.545895 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e726ff1b-819e-4e20-b9a4-0e37a8a92a10 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:49.546662 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e726ff1b-819e-4e20-b9a4-0e37a8a92a10 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:49.547096 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e726ff1b-819e-4e20-b9a4-0e37a8a92a10 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:49.622384 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-cf0f6dd0-b37e-4a77-84fd-87c9d6247f42 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:36:49.622853 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-cf0f6dd0-b37e-4a77-84fd-87c9d6247f42 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:36:49.623546 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-cf0f6dd0-b37e-4a77-84fd-87c9d6247f42 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:36:49.623950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-cf0f6dd0-b37e-4a77-84fd-87c9d6247f42 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:36:49.624357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-cf0f6dd0-b37e-4a77-84fd-87c9d6247f42 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:36:49.632886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf0f6dd0-b37e-4a77-84fd-87c9d6247f42 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:49.633328 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf0f6dd0-b37e-4a77-84fd-87c9d6247f42 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:49.634184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf0f6dd0-b37e-4a77-84fd-87c9d6247f42 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:49.634614 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf0f6dd0-b37e-4a77-84fd-87c9d6247f42 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:49.651997 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-cf0f6dd0-b37e-4a77-84fd-87c9d6247f42 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Getting quotas for project 471e1e958b29427eb024616ca403985f. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:36:49.655946 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-cf0f6dd0-b37e-4a77-84fd-87c9d6247f42 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Getting quotas for user 4e066a1d960f48d2ad78d13fc723f54e and project 471e1e958b29427eb024616ca403985f. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:36:49.683261 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e726ff1b-819e-4e20-b9a4-0e37a8a92a10 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:49.691307 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e726ff1b-819e-4e20-b9a4-0e37a8a92a10 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1318 microversion: 2.1 time: 0.157168 Jul 12 17:36:49.691878 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 509/1045] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:49 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:49.696262 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a5db1f9d-6010-4c3c-b1ee-a289d0ba596d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:49.696862 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a5db1f9d-6010-4c3c-b1ee-a289d0ba596d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:49.703139 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5db1f9d-6010-4c3c-b1ee-a289d0ba596d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:49.703573 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5db1f9d-6010-4c3c-b1ee-a289d0ba596d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:49.704342 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5db1f9d-6010-4c3c-b1ee-a289d0ba596d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:49.704773 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a5db1f9d-6010-4c3c-b1ee-a289d0ba596d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:49.716544 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cf0f6dd0-b37e-4a77-84fd-87c9d6247f42 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:36:49.718630 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cf0f6dd0-b37e-4a77-84fd-87c9d6247f42 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='46631603-8b4e-405d-aa90-eb3c34ec0f9e',volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:36:49.845840 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cf0f6dd0-b37e-4a77-84fd-87c9d6247f42 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.801209 Jul 12 17:36:49.846658 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 537/1046] 10.222.0.62 () {60 vars in 1146 bytes} [Tue Jul 12 17:36:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:36:49.851763 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a5db1f9d-6010-4c3c-b1ee-a289d0ba596d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:49.856123 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7ef6700e-1a05-4085-978b-2383993005a9 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:49.856738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7ef6700e-1a05-4085-978b-2383993005a9 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:49.868959 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a5db1f9d-6010-4c3c-b1ee-a289d0ba596d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:49.870973 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a5db1f9d-6010-4c3c-b1ee-a289d0ba596d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:49.872886 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a5db1f9d-6010-4c3c-b1ee-a289d0ba596d tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1717 microversion: 2.20 time: 0.180053 Jul 12 17:36:49.873450 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 510/1047] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:36:49 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1717 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:36:49.911216 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7ef6700e-1a05-4085-978b-2383993005a9 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:49.918669 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7ef6700e-1a05-4085-978b-2383993005a9 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1095 microversion: 2.1 time: 0.065740 Jul 12 17:36:49.919231 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 538/1048] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:49 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:50.444787 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5f1e27d8-6009-42b6-9a89-e7614e220ca9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:50.445401 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5f1e27d8-6009-42b6-9a89-e7614e220ca9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:50.451873 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5f1e27d8-6009-42b6-9a89-e7614e220ca9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:50.452328 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5f1e27d8-6009-42b6-9a89-e7614e220ca9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:50.453097 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5f1e27d8-6009-42b6-9a89-e7614e220ca9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:50.453542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5f1e27d8-6009-42b6-9a89-e7614e220ca9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:50.580520 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5f1e27d8-6009-42b6-9a89-e7614e220ca9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:50.587922 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5f1e27d8-6009-42b6-9a89-e7614e220ca9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.147161 Jul 12 17:36:50.588488 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 511/1049] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:50 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:50.708206 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-40534de1-09bb-45e5-9e62-1ce9b9ca1363 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:50.708759 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-40534de1-09bb-45e5-9e62-1ce9b9ca1363 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:50.717359 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-40534de1-09bb-45e5-9e62-1ce9b9ca1363 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:50.717825 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-40534de1-09bb-45e5-9e62-1ce9b9ca1363 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:50.718577 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-40534de1-09bb-45e5-9e62-1ce9b9ca1363 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:50.719004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-40534de1-09bb-45e5-9e62-1ce9b9ca1363 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:50.847757 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-40534de1-09bb-45e5-9e62-1ce9b9ca1363 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:50.855268 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-40534de1-09bb-45e5-9e62-1ce9b9ca1363 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1505 microversion: 2.1 time: 0.150888 Jul 12 17:36:50.856342 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 539/1050] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:50 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:50.872388 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c91a69f1-5d35-46ee-a9de-4b7f362a4ac1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e9c84a2-b7fa-411a-b340-df10a02533af", "device": "/dev/sdb"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:36:50.874056 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c91a69f1-5d35-46ee-a9de-4b7f362a4ac1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:50.880012 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c91a69f1-5d35-46ee-a9de-4b7f362a4ac1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:50.880469 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c91a69f1-5d35-46ee-a9de-4b7f362a4ac1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:50.881239 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c91a69f1-5d35-46ee-a9de-4b7f362a4ac1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:50.881674 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c91a69f1-5d35-46ee-a9de-4b7f362a4ac1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:50.935921 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7f07ff6b-d842-4747-b11d-00ed3f772da2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:50.936538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7f07ff6b-d842-4747-b11d-00ed3f772da2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:50.942667 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7f07ff6b-d842-4747-b11d-00ed3f772da2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:50.943122 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7f07ff6b-d842-4747-b11d-00ed3f772da2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:50.943885 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7f07ff6b-d842-4747-b11d-00ed3f772da2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:50.944322 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7f07ff6b-d842-4747-b11d-00ed3f772da2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:51.004788 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7f07ff6b-d842-4747-b11d-00ed3f772da2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:51.012010 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7f07ff6b-d842-4747-b11d-00ed3f772da2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1145 microversion: 2.1 time: 0.080495 Jul 12 17:36:51.012571 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 540/1051] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:50 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:51.604344 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a62874fa-9133-4651-98ae-6ac4a4754e61 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:51.605012 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a62874fa-9133-4651-98ae-6ac4a4754e61 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:51.607456 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:36:51.612563 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a62874fa-9133-4651-98ae-6ac4a4754e61 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:51.613009 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a62874fa-9133-4651-98ae-6ac4a4754e61 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:51.613785 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a62874fa-9133-4651-98ae-6ac4a4754e61 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:51.614213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a62874fa-9133-4651-98ae-6ac4a4754e61 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:51.741356 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a62874fa-9133-4651-98ae-6ac4a4754e61 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:51.748924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a62874fa-9133-4651-98ae-6ac4a4754e61 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.148458 Jul 12 17:36:51.749775 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 541/1052] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:51 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:52.014401 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c91a69f1-5d35-46ee-a9de-4b7f362a4ac1 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "POST /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.146309 Jul 12 17:36:52.015314 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 512/1053] 10.222.0.62 () {60 vars in 1322 bytes} [Tue Jul 12 17:36:50 2022] POST /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc/os-volume_attachments => generated 194 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:36:52.028444 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ad7e6eaa-6b44-451e-a840-4d392a2f3590 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:52.030041 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ad7e6eaa-6b44-451e-a840-4d392a2f3590 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:52.038403 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ad7e6eaa-6b44-451e-a840-4d392a2f3590 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:52.038902 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ad7e6eaa-6b44-451e-a840-4d392a2f3590 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:52.039853 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ad7e6eaa-6b44-451e-a840-4d392a2f3590 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:52.040448 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ad7e6eaa-6b44-451e-a840-4d392a2f3590 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:52.116817 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ad7e6eaa-6b44-451e-a840-4d392a2f3590 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:52.124349 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ad7e6eaa-6b44-451e-a840-4d392a2f3590 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1193 microversion: 2.1 time: 0.099883 Jul 12 17:36:52.124918 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 542/1054] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:52 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1193 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:52.767134 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d2b715c6-b860-4bab-9a67-85787133b015 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:52.768147 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d2b715c6-b860-4bab-9a67-85787133b015 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:52.776791 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d2b715c6-b860-4bab-9a67-85787133b015 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:52.777252 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d2b715c6-b860-4bab-9a67-85787133b015 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:52.779141 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d2b715c6-b860-4bab-9a67-85787133b015 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:52.779577 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d2b715c6-b860-4bab-9a67-85787133b015 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:52.970330 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d2b715c6-b860-4bab-9a67-85787133b015 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:52.978129 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d2b715c6-b860-4bab-9a67-85787133b015 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1568 microversion: 2.1 time: 0.216328 Jul 12 17:36:52.978702 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 513/1055] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:52 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:52.994422 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d2b4926e-c69d-4f86-862b-a0b409b1ddf3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:36:52.994979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d2b4926e-c69d-4f86-862b-a0b409b1ddf3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:53.001209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d2b4926e-c69d-4f86-862b-a0b409b1ddf3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:53.001781 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d2b4926e-c69d-4f86-862b-a0b409b1ddf3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:53.002627 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d2b4926e-c69d-4f86-862b-a0b409b1ddf3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:53.003320 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d2b4926e-c69d-4f86-862b-a0b409b1ddf3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:53.142995 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-27d0885a-d8f2-4feb-9665-f06e539c9f8b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:53.143520 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d2b4926e-c69d-4f86-862b-a0b409b1ddf3 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "POST /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed/action" status: 202 len: 0 microversion: 2.1 time: 0.152956 Jul 12 17:36:53.144641 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 543/1056] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Jul 12 17:36:52 2022] POST /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:36:53.145333 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-27d0885a-d8f2-4feb-9665-f06e539c9f8b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:53.151618 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-27d0885a-d8f2-4feb-9665-f06e539c9f8b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:53.152314 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-27d0885a-d8f2-4feb-9665-f06e539c9f8b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:53.153240 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-27d0885a-d8f2-4feb-9665-f06e539c9f8b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:53.154572 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-27d0885a-d8f2-4feb-9665-f06e539c9f8b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:53.154696 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8ad3fd7c-a181-4343-b5a5-b360a821dc62 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:53.155512 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8ad3fd7c-a181-4343-b5a5-b360a821dc62 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:53.163119 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8ad3fd7c-a181-4343-b5a5-b360a821dc62 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:53.163739 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8ad3fd7c-a181-4343-b5a5-b360a821dc62 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:53.164697 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8ad3fd7c-a181-4343-b5a5-b360a821dc62 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:53.165274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8ad3fd7c-a181-4343-b5a5-b360a821dc62 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:53.777720 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8ad3fd7c-a181-4343-b5a5-b360a821dc62 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:53.785482 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8ad3fd7c-a181-4343-b5a5-b360a821dc62 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1516 microversion: 2.1 time: 0.637066 Jul 12 17:36:53.786205 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 544/1057] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:53 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1516 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:53.802884 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-27d0885a-d8f2-4feb-9665-f06e539c9f8b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:53.811912 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-27d0885a-d8f2-4feb-9665-f06e539c9f8b tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1278 microversion: 2.1 time: 0.674048 Jul 12 17:36:53.812484 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 514/1058] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:53 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1278 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:54.477045 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-4cd6b6da-a975-44a5-bd96-4c836a3320ac req-d87d3070-31eb-4287-b65d-7944e8b7f21f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659c2528-8d70-483d-8fa3-dad061e504cb", "tag": "69957ac6-cba3-4a17-bf8c-7ef2a062fe49"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:36:54.486280 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-4cd6b6da-a975-44a5-bd96-4c836a3320ac req-d87d3070-31eb-4287-b65d-7944e8b7f21f service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:54.486808 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-4cd6b6da-a975-44a5-bd96-4c836a3320ac req-d87d3070-31eb-4287-b65d-7944e8b7f21f service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:54.499154 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-4cd6b6da-a975-44a5-bd96-4c836a3320ac req-d87d3070-31eb-4287-b65d-7944e8b7f21f service nova] Creating event network-changed:69957ac6-cba3-4a17-bf8c-7ef2a062fe49 for instance 659c2528-8d70-483d-8fa3-dad061e504cb on hv-cinder-84932 Jul 12 17:36:54.504051 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-4cd6b6da-a975-44a5-bd96-4c836a3320ac req-d87d3070-31eb-4287-b65d-7944e8b7f21f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108931 Jul 12 17:36:54.504655 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 545/1059] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:36:54.803137 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-de7a9ff1-fed9-4687-af18-4c5730b893a5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:54.803744 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-de7a9ff1-fed9-4687-af18-4c5730b893a5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:54.810438 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-de7a9ff1-fed9-4687-af18-4c5730b893a5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:54.810884 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-de7a9ff1-fed9-4687-af18-4c5730b893a5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:54.811642 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-de7a9ff1-fed9-4687-af18-4c5730b893a5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:54.812073 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-de7a9ff1-fed9-4687-af18-4c5730b893a5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:54.828806 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6e19e4a8-202f-4f50-8d5e-4605ac6a55d6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:54.829789 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6e19e4a8-202f-4f50-8d5e-4605ac6a55d6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:54.835838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e19e4a8-202f-4f50-8d5e-4605ac6a55d6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:54.836282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e19e4a8-202f-4f50-8d5e-4605ac6a55d6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:54.837214 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e19e4a8-202f-4f50-8d5e-4605ac6a55d6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:54.837645 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e19e4a8-202f-4f50-8d5e-4605ac6a55d6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:55.084913 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-de7a9ff1-fed9-4687-af18-4c5730b893a5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:55.092602 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-de7a9ff1-fed9-4687-af18-4c5730b893a5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1518 microversion: 2.1 time: 0.293321 Jul 12 17:36:55.104112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6e19e4a8-202f-4f50-8d5e-4605ac6a55d6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:55.105936 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 515/1060] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:54 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1518 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:55.112416 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6e19e4a8-202f-4f50-8d5e-4605ac6a55d6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1278 microversion: 2.1 time: 0.287741 Jul 12 17:36:55.113332 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 546/1061] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:54 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1278 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:55.123200 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-8dcf3aaf-5b77-4cfb-8b5a-38a9be423e3c req-3f5a93e1-5bf7-47c2-95bd-9756e5377a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdfd07ca-55f6-48b2-b2c7-f202196e05ed", "name": "network-vif-unplugged", "status": "completed", "tag": "78ee797f-f3e0-4e02-ba3d-1c9755d72b65"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:36:55.133142 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-8dcf3aaf-5b77-4cfb-8b5a-38a9be423e3c req-3f5a93e1-5bf7-47c2-95bd-9756e5377a06 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:55.133775 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-8dcf3aaf-5b77-4cfb-8b5a-38a9be423e3c req-3f5a93e1-5bf7-47c2-95bd-9756e5377a06 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:55.145116 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.compute.server_external_events [req-8dcf3aaf-5b77-4cfb-8b5a-38a9be423e3c req-3f5a93e1-5bf7-47c2-95bd-9756e5377a06 service nova] Unable to find a host for instance bdfd07ca-55f6-48b2-b2c7-f202196e05ed. Dropping event network-vif-unplugged {{(pid=117939) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 12 17:36:55.146028 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-8dcf3aaf-5b77-4cfb-8b5a-38a9be423e3c req-3f5a93e1-5bf7-47c2-95bd-9756e5377a06 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037668 Jul 12 17:36:55.154113 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 516/1062] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 12 17:36:56.112030 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b2c01246-8caf-44af-851a-389ab564bdd9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:56.112637 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b2c01246-8caf-44af-851a-389ab564bdd9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:56.119141 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b2c01246-8caf-44af-851a-389ab564bdd9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:56.119589 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b2c01246-8caf-44af-851a-389ab564bdd9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:56.120348 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b2c01246-8caf-44af-851a-389ab564bdd9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:56.120783 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b2c01246-8caf-44af-851a-389ab564bdd9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:56.128937 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-32db7e2b-9325-46eb-b432-c8d2dd8e5447 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:56.129543 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-32db7e2b-9325-46eb-b432-c8d2dd8e5447 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:56.136263 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-32db7e2b-9325-46eb-b432-c8d2dd8e5447 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:56.136723 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-32db7e2b-9325-46eb-b432-c8d2dd8e5447 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:56.137497 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-32db7e2b-9325-46eb-b432-c8d2dd8e5447 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:56.137977 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-32db7e2b-9325-46eb-b432-c8d2dd8e5447 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:56.304795 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b2c01246-8caf-44af-851a-389ab564bdd9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:56.313698 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b2c01246-8caf-44af-851a-389ab564bdd9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1518 microversion: 2.1 time: 0.205467 Jul 12 17:36:56.314772 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 547/1063] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:56 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1518 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:56.333775 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-32db7e2b-9325-46eb-b432-c8d2dd8e5447 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:56.341574 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-32db7e2b-9325-46eb-b432-c8d2dd8e5447 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1278 microversion: 2.1 time: 0.215989 Jul 12 17:36:56.342178 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 517/1064] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:56 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1278 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:57.331316 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a7349e94-e097-4dfe-ba04-f8e3e7459ed9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:57.331922 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a7349e94-e097-4dfe-ba04-f8e3e7459ed9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:57.338428 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a7349e94-e097-4dfe-ba04-f8e3e7459ed9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:57.338872 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a7349e94-e097-4dfe-ba04-f8e3e7459ed9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:57.339619 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a7349e94-e097-4dfe-ba04-f8e3e7459ed9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:57.340051 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a7349e94-e097-4dfe-ba04-f8e3e7459ed9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:57.355287 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:36:57.358149 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2d62a4a5-3dd5-4aed-9701-2f99d3c566a1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:57.359347 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2d62a4a5-3dd5-4aed-9701-2f99d3c566a1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:57.365444 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2d62a4a5-3dd5-4aed-9701-2f99d3c566a1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:57.365971 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2d62a4a5-3dd5-4aed-9701-2f99d3c566a1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:57.366757 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2d62a4a5-3dd5-4aed-9701-2f99d3c566a1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:57.367139 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2d62a4a5-3dd5-4aed-9701-2f99d3c566a1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:57.540857 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a7349e94-e097-4dfe-ba04-f8e3e7459ed9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:57.545606 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2d62a4a5-3dd5-4aed-9701-2f99d3c566a1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:57.547885 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:36:57.548701 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a7349e94-e097-4dfe-ba04-f8e3e7459ed9 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1518 microversion: 2.1 time: 0.221007 Jul 12 17:36:57.549391 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 548/1065] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:57 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1518 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:57.555511 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2d62a4a5-3dd5-4aed-9701-2f99d3c566a1 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1278 microversion: 2.1 time: 0.201052 Jul 12 17:36:57.556069 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 518/1066] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:57 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1278 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:36:58.565585 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1120c9b5-87fc-445e-8240-675025dfe78b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:58.566285 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1120c9b5-87fc-445e-8240-675025dfe78b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:58.573178 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1120c9b5-87fc-445e-8240-675025dfe78b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:58.573632 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1120c9b5-87fc-445e-8240-675025dfe78b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:58.574692 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1120c9b5-87fc-445e-8240-675025dfe78b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:58.575327 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1120c9b5-87fc-445e-8240-675025dfe78b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:58.575684 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8f66c31f-99b2-4169-86a9-a84992fdd094 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:58.577248 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8f66c31f-99b2-4169-86a9-a84992fdd094 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:58.587167 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8f66c31f-99b2-4169-86a9-a84992fdd094 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:58.587781 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8f66c31f-99b2-4169-86a9-a84992fdd094 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:58.588705 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8f66c31f-99b2-4169-86a9-a84992fdd094 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:58.589311 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8f66c31f-99b2-4169-86a9-a84992fdd094 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:58.784055 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1120c9b5-87fc-445e-8240-675025dfe78b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:58.791533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1120c9b5-87fc-445e-8240-675025dfe78b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1518 microversion: 2.1 time: 0.230074 Jul 12 17:36:58.792105 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 549/1067] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:58 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1518 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:58.797411 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cc882f2d-797a-4dc7-81ee-ae85aecb1d56 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:58.797798 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8f66c31f-99b2-4169-86a9-a84992fdd094 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:36:58.797935 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cc882f2d-797a-4dc7-81ee-ae85aecb1d56 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:58.803730 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cc882f2d-797a-4dc7-81ee-ae85aecb1d56 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:58.804175 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cc882f2d-797a-4dc7-81ee-ae85aecb1d56 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:58.804938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cc882f2d-797a-4dc7-81ee-ae85aecb1d56 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:58.805068 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8f66c31f-99b2-4169-86a9-a84992fdd094 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1278 microversion: 2.1 time: 0.235651 Jul 12 17:36:58.805372 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cc882f2d-797a-4dc7-81ee-ae85aecb1d56 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:58.805665 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 519/1068] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:58 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1278 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:36:58.883132 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-cc882f2d-797a-4dc7-81ee-ae85aecb1d56 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lazy-loading 'services' on Instance uuid 88e50bdd-3716-421f-b6ca-832ee1f63c42 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:36:58.953909 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cc882f2d-797a-4dc7-81ee-ae85aecb1d56 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "DELETE /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments/85218626-ae8d-41e6-9c02-af5f572ba3dc" status: 202 len: 0 microversion: 2.1 time: 0.160571 Jul 12 17:36:58.954876 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 550/1069] 10.222.0.62 () {58 vars in 1415 bytes} [Tue Jul 12 17:36:58 2022] DELETE /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments/85218626-ae8d-41e6-9c02-af5f572ba3dc => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:36:58.963286 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4cec713e-f276-4089-835c-5aa0a1707670 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:58.964239 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4cec713e-f276-4089-835c-5aa0a1707670 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:58.970799 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4cec713e-f276-4089-835c-5aa0a1707670 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:58.971243 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4cec713e-f276-4089-835c-5aa0a1707670 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:58.972038 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4cec713e-f276-4089-835c-5aa0a1707670 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:58.972490 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4cec713e-f276-4089-835c-5aa0a1707670 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:59.001430 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4cec713e-f276-4089-835c-5aa0a1707670 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041970 Jul 12 17:36:59.001938 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 520/1070] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:36:58 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:36:59.809297 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-509327b5-7ff0-4ed7-9cb4-fbc1cb016b5f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:59.810012 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-509327b5-7ff0-4ed7-9cb4-fbc1cb016b5f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:59.812985 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:36:59.819028 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-509327b5-7ff0-4ed7-9cb4-fbc1cb016b5f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:59.819480 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-509327b5-7ff0-4ed7-9cb4-fbc1cb016b5f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:59.820238 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-509327b5-7ff0-4ed7-9cb4-fbc1cb016b5f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:59.820665 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-509327b5-7ff0-4ed7-9cb4-fbc1cb016b5f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:59.822174 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f9de363d-8d51-41cf-abde-53d95b838018 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:36:59.822789 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f9de363d-8d51-41cf-abde-53d95b838018 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:36:59.829440 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f9de363d-8d51-41cf-abde-53d95b838018 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:59.830062 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f9de363d-8d51-41cf-abde-53d95b838018 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:59.830815 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f9de363d-8d51-41cf-abde-53d95b838018 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:36:59.831254 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f9de363d-8d51-41cf-abde-53d95b838018 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:36:59.915777 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=8 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:37:00.017137 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-509327b5-7ff0-4ed7-9cb4-fbc1cb016b5f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:00.020527 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f9de363d-8d51-41cf-abde-53d95b838018 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:00.024727 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-509327b5-7ff0-4ed7-9cb4-fbc1cb016b5f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1518 microversion: 2.1 time: 0.219552 Jul 12 17:37:00.025384 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 551/1071] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:59 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1518 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:00.027897 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f9de363d-8d51-41cf-abde-53d95b838018 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1278 microversion: 2.1 time: 0.209543 Jul 12 17:37:00.028455 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 521/1072] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:36:59 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1278 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:37:00.030486 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6e037e7f-c826-4c78-85c0-f3c7d1fcb452 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:00.031455 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6e037e7f-c826-4c78-85c0-f3c7d1fcb452 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:00.037131 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e037e7f-c826-4c78-85c0-f3c7d1fcb452 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:00.037584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e037e7f-c826-4c78-85c0-f3c7d1fcb452 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:00.038379 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e037e7f-c826-4c78-85c0-f3c7d1fcb452 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:00.038817 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6e037e7f-c826-4c78-85c0-f3c7d1fcb452 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:00.067891 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6e037e7f-c826-4c78-85c0-f3c7d1fcb452 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041497 Jul 12 17:37:00.068437 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 552/1073] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:37:00 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:37:01.041792 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a24ac161-0047-4ee4-b4ab-714c94fcad6f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:01.042404 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a24ac161-0047-4ee4-b4ab-714c94fcad6f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:01.044688 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-826b89af-2a38-4fe6-b62c-ddf6f8514573 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:01.045296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-826b89af-2a38-4fe6-b62c-ddf6f8514573 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:01.048983 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a24ac161-0047-4ee4-b4ab-714c94fcad6f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:01.049426 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a24ac161-0047-4ee4-b4ab-714c94fcad6f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:01.050226 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a24ac161-0047-4ee4-b4ab-714c94fcad6f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:01.050659 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a24ac161-0047-4ee4-b4ab-714c94fcad6f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:01.051605 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-826b89af-2a38-4fe6-b62c-ddf6f8514573 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:01.052054 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-826b89af-2a38-4fe6-b62c-ddf6f8514573 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:01.052808 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-826b89af-2a38-4fe6-b62c-ddf6f8514573 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:01.053244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-826b89af-2a38-4fe6-b62c-ddf6f8514573 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:01.246127 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a24ac161-0047-4ee4-b4ab-714c94fcad6f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:01.251082 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-826b89af-2a38-4fe6-b62c-ddf6f8514573 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:01.254142 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a24ac161-0047-4ee4-b4ab-714c94fcad6f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1518 microversion: 2.1 time: 0.216299 Jul 12 17:37:01.254712 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 522/1074] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:01 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1518 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:01.258600 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-826b89af-2a38-4fe6-b62c-ddf6f8514573 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1278 microversion: 2.1 time: 0.217679 Jul 12 17:37:01.259149 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 553/1075] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:01 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1278 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:37:01.259590 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-083eae36-9a80-4835-b974-000ffbfd3851 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:01.260556 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-083eae36-9a80-4835-b974-000ffbfd3851 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:01.266448 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-083eae36-9a80-4835-b974-000ffbfd3851 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:01.266896 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-083eae36-9a80-4835-b974-000ffbfd3851 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:01.267654 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-083eae36-9a80-4835-b974-000ffbfd3851 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:01.268085 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-083eae36-9a80-4835-b974-000ffbfd3851 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:01.295949 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-083eae36-9a80-4835-b974-000ffbfd3851 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039955 Jul 12 17:37:01.296454 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 523/1076] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:37:01 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:37:02.270913 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2c6d68e5-8d84-4aa6-bda8-9f79d08f559d tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:02.271529 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2c6d68e5-8d84-4aa6-bda8-9f79d08f559d tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:02.274958 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-31fed5fa-0eb4-4260-a82d-f8c34974c16d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:02.275571 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-31fed5fa-0eb4-4260-a82d-f8c34974c16d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:02.278075 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c6d68e5-8d84-4aa6-bda8-9f79d08f559d tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:02.278522 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c6d68e5-8d84-4aa6-bda8-9f79d08f559d tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:02.279288 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c6d68e5-8d84-4aa6-bda8-9f79d08f559d tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:02.279726 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c6d68e5-8d84-4aa6-bda8-9f79d08f559d tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:02.282127 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-31fed5fa-0eb4-4260-a82d-f8c34974c16d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:02.282612 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-31fed5fa-0eb4-4260-a82d-f8c34974c16d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:02.283397 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-31fed5fa-0eb4-4260-a82d-f8c34974c16d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:02.283838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-31fed5fa-0eb4-4260-a82d-f8c34974c16d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:02.472007 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2c6d68e5-8d84-4aa6-bda8-9f79d08f559d tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:02.476380 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-31fed5fa-0eb4-4260-a82d-f8c34974c16d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:02.479642 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2c6d68e5-8d84-4aa6-bda8-9f79d08f559d tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1518 microversion: 2.1 time: 0.212727 Jul 12 17:37:02.480207 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 554/1077] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:02 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1518 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:02.484015 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-31fed5fa-0eb4-4260-a82d-f8c34974c16d tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1278 microversion: 2.1 time: 0.212823 Jul 12 17:37:02.484575 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 524/1078] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:02 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1278 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:37:02.484805 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-32eb3264-8a55-4489-ab9b-a29dfa53aba8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:02.486160 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-32eb3264-8a55-4489-ab9b-a29dfa53aba8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:02.491944 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-32eb3264-8a55-4489-ab9b-a29dfa53aba8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:02.492390 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-32eb3264-8a55-4489-ab9b-a29dfa53aba8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:02.493175 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-32eb3264-8a55-4489-ab9b-a29dfa53aba8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:02.493606 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-32eb3264-8a55-4489-ab9b-a29dfa53aba8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:02.522301 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-32eb3264-8a55-4489-ab9b-a29dfa53aba8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041136 Jul 12 17:37:02.522837 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 555/1079] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:37:02 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:37:03.496343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a3921a8d-c360-4a8c-bc1c-2c6066a399e1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:03.496966 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a3921a8d-c360-4a8c-bc1c-2c6066a399e1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:03.499296 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=74 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:37:03.500106 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-973f5698-4212-499d-87bb-a3cadda6bb99 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:03.500714 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-973f5698-4212-499d-87bb-a3cadda6bb99 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:03.504728 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a3921a8d-c360-4a8c-bc1c-2c6066a399e1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:03.505182 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a3921a8d-c360-4a8c-bc1c-2c6066a399e1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:03.505994 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a3921a8d-c360-4a8c-bc1c-2c6066a399e1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:03.506433 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a3921a8d-c360-4a8c-bc1c-2c6066a399e1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:03.507089 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-973f5698-4212-499d-87bb-a3cadda6bb99 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:03.507535 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-973f5698-4212-499d-87bb-a3cadda6bb99 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:03.508287 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-973f5698-4212-499d-87bb-a3cadda6bb99 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:03.508715 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-973f5698-4212-499d-87bb-a3cadda6bb99 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:03.707424 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-973f5698-4212-499d-87bb-a3cadda6bb99 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:03.710481 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a3921a8d-c360-4a8c-bc1c-2c6066a399e1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:03.716585 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-973f5698-4212-499d-87bb-a3cadda6bb99 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1278 microversion: 2.1 time: 0.220141 Jul 12 17:37:03.717531 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 556/1080] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:03 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1278 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:37:03.722184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-15e16891-477f-4315-8804-a1f91a1d029e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:03.723105 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-15e16891-477f-4315-8804-a1f91a1d029e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:03.727341 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a3921a8d-c360-4a8c-bc1c-2c6066a399e1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1518 microversion: 2.1 time: 0.234736 Jul 12 17:37:03.736589 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 525/1081] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:03 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1518 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:03.736764 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15e16891-477f-4315-8804-a1f91a1d029e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:03.736764 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15e16891-477f-4315-8804-a1f91a1d029e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:03.736764 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15e16891-477f-4315-8804-a1f91a1d029e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:03.736764 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15e16891-477f-4315-8804-a1f91a1d029e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:03.760578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-15e16891-477f-4315-8804-a1f91a1d029e tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042033 Jul 12 17:37:03.761991 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 557/1082] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:37:03 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:37:04.734338 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-839274b1-a9ef-4753-b380-9b8de4aad056 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:04.734956 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-839274b1-a9ef-4753-b380-9b8de4aad056 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:04.741828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-839274b1-a9ef-4753-b380-9b8de4aad056 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:04.742282 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-839274b1-a9ef-4753-b380-9b8de4aad056 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:04.743090 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-839274b1-a9ef-4753-b380-9b8de4aad056 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:04.743529 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-839274b1-a9ef-4753-b380-9b8de4aad056 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:04.746277 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4db422a0-1024-4f2a-94d9-7e9db22724ac tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:04.747028 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4db422a0-1024-4f2a-94d9-7e9db22724ac tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:04.754172 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4db422a0-1024-4f2a-94d9-7e9db22724ac tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:04.754730 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4db422a0-1024-4f2a-94d9-7e9db22724ac tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:04.755571 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4db422a0-1024-4f2a-94d9-7e9db22724ac tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:04.756009 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4db422a0-1024-4f2a-94d9-7e9db22724ac tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:04.951621 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-839274b1-a9ef-4753-b380-9b8de4aad056 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:04.955362 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4db422a0-1024-4f2a-94d9-7e9db22724ac tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:04.960048 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-839274b1-a9ef-4753-b380-9b8de4aad056 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1278 microversion: 2.1 time: 0.230237 Jul 12 17:37:04.960620 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 526/1083] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:04 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1278 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:04.965633 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6a46fbc4-0311-47a0-8225-0338ceee1f5d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:04.967215 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6a46fbc4-0311-47a0-8225-0338ceee1f5d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:04.973079 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4db422a0-1024-4f2a-94d9-7e9db22724ac tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1518 microversion: 2.1 time: 0.231190 Jul 12 17:37:04.973294 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6a46fbc4-0311-47a0-8225-0338ceee1f5d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:04.973727 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6a46fbc4-0311-47a0-8225-0338ceee1f5d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:04.974182 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 558/1084] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:04 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1518 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:04.974487 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6a46fbc4-0311-47a0-8225-0338ceee1f5d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:04.974995 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6a46fbc4-0311-47a0-8225-0338ceee1f5d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:05.004742 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6a46fbc4-0311-47a0-8225-0338ceee1f5d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043013 Jul 12 17:37:05.005304 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 527/1085] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:37:04 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:37:05.980813 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7a5ce839-79b9-4826-ad22-7819573c7f2e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:05.981360 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7a5ce839-79b9-4826-ad22-7819573c7f2e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:05.988542 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7a5ce839-79b9-4826-ad22-7819573c7f2e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:05.988997 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7a5ce839-79b9-4826-ad22-7819573c7f2e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:05.989946 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7a5ce839-79b9-4826-ad22-7819573c7f2e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:05.990644 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7a5ce839-79b9-4826-ad22-7819573c7f2e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:05.991306 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-61085e28-ea9b-4482-8b98-63568501a848 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:05.992088 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-61085e28-ea9b-4482-8b98-63568501a848 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:06.001418 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-61085e28-ea9b-4482-8b98-63568501a848 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:06.002082 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-61085e28-ea9b-4482-8b98-63568501a848 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:06.003203 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-61085e28-ea9b-4482-8b98-63568501a848 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:06.003792 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-61085e28-ea9b-4482-8b98-63568501a848 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:06.198520 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7a5ce839-79b9-4826-ad22-7819573c7f2e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:06.201916 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-61085e28-ea9b-4482-8b98-63568501a848 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:06.206049 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7a5ce839-79b9-4826-ad22-7819573c7f2e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1266 microversion: 2.1 time: 0.232454 Jul 12 17:37:06.206613 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 559/1086] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:05 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:06.209672 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-61085e28-ea9b-4482-8b98-63568501a848 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1518 microversion: 2.1 time: 0.222732 Jul 12 17:37:06.210388 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 528/1087] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:05 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1518 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:06.214643 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-da12de63-9377-4e4e-9a75-8449e5f9cdac tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:06.215662 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-da12de63-9377-4e4e-9a75-8449e5f9cdac tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:06.222653 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-da12de63-9377-4e4e-9a75-8449e5f9cdac tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:06.223095 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-da12de63-9377-4e4e-9a75-8449e5f9cdac tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:06.223857 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-da12de63-9377-4e4e-9a75-8449e5f9cdac tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:06.224302 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-da12de63-9377-4e4e-9a75-8449e5f9cdac tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:06.252856 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-da12de63-9377-4e4e-9a75-8449e5f9cdac tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042012 Jul 12 17:37:06.253416 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 560/1088] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:37:06 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:37:07.223337 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-04cc1273-dc8a-4fdf-a3e8-15e450893fea tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:07.223945 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-04cc1273-dc8a-4fdf-a3e8-15e450893fea tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:07.226677 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-66d78e13-3a54-465b-a879-c981f1a457dc tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:07.227287 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-66d78e13-3a54-465b-a879-c981f1a457dc tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:07.230490 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-04cc1273-dc8a-4fdf-a3e8-15e450893fea tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:07.230937 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-04cc1273-dc8a-4fdf-a3e8-15e450893fea tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:07.231696 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-04cc1273-dc8a-4fdf-a3e8-15e450893fea tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:07.232639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-04cc1273-dc8a-4fdf-a3e8-15e450893fea tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:07.234272 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66d78e13-3a54-465b-a879-c981f1a457dc tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:07.234728 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66d78e13-3a54-465b-a879-c981f1a457dc tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:07.235589 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66d78e13-3a54-465b-a879-c981f1a457dc tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:07.236026 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-66d78e13-3a54-465b-a879-c981f1a457dc tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:07.428327 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-04cc1273-dc8a-4fdf-a3e8-15e450893fea tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:07.432877 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-66d78e13-3a54-465b-a879-c981f1a457dc tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:07.436209 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-04cc1273-dc8a-4fdf-a3e8-15e450893fea tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1266 microversion: 2.1 time: 0.216720 Jul 12 17:37:07.436901 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 529/1089] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:07 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:07.441784 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-66d78e13-3a54-465b-a879-c981f1a457dc tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1518 microversion: 2.1 time: 0.218941 Jul 12 17:37:07.441953 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f728e5c0-aa47-40e3-a8ac-ec267e3713b3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:07.442345 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 561/1090] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:07 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1518 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:37:07.442810 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f728e5c0-aa47-40e3-a8ac-ec267e3713b3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:07.448515 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f728e5c0-aa47-40e3-a8ac-ec267e3713b3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:07.448959 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f728e5c0-aa47-40e3-a8ac-ec267e3713b3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:07.449739 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f728e5c0-aa47-40e3-a8ac-ec267e3713b3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:07.450177 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f728e5c0-aa47-40e3-a8ac-ec267e3713b3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:07.480196 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f728e5c0-aa47-40e3-a8ac-ec267e3713b3 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042444 Jul 12 17:37:07.480739 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 530/1091] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:37:07 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:37:08.453741 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9ef6694e-170c-4364-b86a-f5e4f6194031 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:08.454297 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9ef6694e-170c-4364-b86a-f5e4f6194031 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:08.458313 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1421a3dc-a6b5-40ca-b3b5-31d992653660 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:08.458919 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1421a3dc-a6b5-40ca-b3b5-31d992653660 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:08.460759 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ef6694e-170c-4364-b86a-f5e4f6194031 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:08.461209 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ef6694e-170c-4364-b86a-f5e4f6194031 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:08.462010 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ef6694e-170c-4364-b86a-f5e4f6194031 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:08.462452 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9ef6694e-170c-4364-b86a-f5e4f6194031 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:08.465232 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1421a3dc-a6b5-40ca-b3b5-31d992653660 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:08.465676 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1421a3dc-a6b5-40ca-b3b5-31d992653660 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:08.466524 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1421a3dc-a6b5-40ca-b3b5-31d992653660 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:08.466958 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1421a3dc-a6b5-40ca-b3b5-31d992653660 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:08.609756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1421a3dc-a6b5-40ca-b3b5-31d992653660 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:08.617521 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1421a3dc-a6b5-40ca-b3b5-31d992653660 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1518 microversion: 2.1 time: 0.162952 Jul 12 17:37:08.618140 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 531/1092] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:08 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:37:08.623474 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-56d97667-8865-4391-bc5d-55b5029b53c5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:08.624619 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-56d97667-8865-4391-bc5d-55b5029b53c5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:08.630985 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-56d97667-8865-4391-bc5d-55b5029b53c5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:08.631434 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-56d97667-8865-4391-bc5d-55b5029b53c5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:08.632214 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-56d97667-8865-4391-bc5d-55b5029b53c5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:08.632651 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-56d97667-8865-4391-bc5d-55b5029b53c5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:08.661495 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-56d97667-8865-4391-bc5d-55b5029b53c5 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042305 Jul 12 17:37:08.662086 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 532/1093] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:37:08 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:37:08.738867 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9ef6694e-170c-4364-b86a-f5e4f6194031 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:08.746309 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9ef6694e-170c-4364-b86a-f5e4f6194031 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1266 microversion: 2.1 time: 0.297147 Jul 12 17:37:08.746865 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 562/1094] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:08 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1266 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:09.635063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d3f3acb2-e520-4587-a9f1-77dd3746c2d1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:09.635691 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d3f3acb2-e520-4587-a9f1-77dd3746c2d1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:09.642144 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d3f3acb2-e520-4587-a9f1-77dd3746c2d1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:09.642598 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d3f3acb2-e520-4587-a9f1-77dd3746c2d1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:09.643361 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d3f3acb2-e520-4587-a9f1-77dd3746c2d1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:09.643800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d3f3acb2-e520-4587-a9f1-77dd3746c2d1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:09.672955 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-736f2206-90dc-4747-abaa-983989e25bc2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:09.673929 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-736f2206-90dc-4747-abaa-983989e25bc2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:09.680461 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-736f2206-90dc-4747-abaa-983989e25bc2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:09.680914 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-736f2206-90dc-4747-abaa-983989e25bc2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:09.681697 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-736f2206-90dc-4747-abaa-983989e25bc2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:09.682142 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-736f2206-90dc-4747-abaa-983989e25bc2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:09.711530 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-736f2206-90dc-4747-abaa-983989e25bc2 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042998 Jul 12 17:37:09.712080 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 563/1095] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:37:09 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:37:09.763485 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-69ae6ab3-4db1-415a-af66-3e3e70b07125 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:09.764100 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-69ae6ab3-4db1-415a-af66-3e3e70b07125 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:09.770280 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-69ae6ab3-4db1-415a-af66-3e3e70b07125 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:09.770732 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-69ae6ab3-4db1-415a-af66-3e3e70b07125 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:09.771502 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-69ae6ab3-4db1-415a-af66-3e3e70b07125 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:09.772162 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-69ae6ab3-4db1-415a-af66-3e3e70b07125 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:09.773800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d3f3acb2-e520-4587-a9f1-77dd3746c2d1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:09.781882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d3f3acb2-e520-4587-a9f1-77dd3746c2d1 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1518 microversion: 2.1 time: 0.150675 Jul 12 17:37:09.782450 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 533/1096] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:09 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:09.787068 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:37:09.900021 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-69ae6ab3-4db1-415a-af66-3e3e70b07125 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:09.907762 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-69ae6ab3-4db1-415a-af66-3e3e70b07125 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1266 microversion: 2.1 time: 0.148136 Jul 12 17:37:09.908310 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 564/1097] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:09 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:37:10.723163 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-74d9d826-641c-4263-bfe4-667b66a0ecf0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:10.724103 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-74d9d826-641c-4263-bfe4-667b66a0ecf0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:10.730509 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-74d9d826-641c-4263-bfe4-667b66a0ecf0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:10.730955 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-74d9d826-641c-4263-bfe4-667b66a0ecf0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:10.731707 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-74d9d826-641c-4263-bfe4-667b66a0ecf0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:10.732136 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-74d9d826-641c-4263-bfe4-667b66a0ecf0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:10.762827 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-74d9d826-641c-4263-bfe4-667b66a0ecf0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043663 Jul 12 17:37:10.764068 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 534/1098] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:37:10 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:37:10.797916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-98465c65-dd8b-4b16-a366-c4142dbafe4c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:10.798528 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-98465c65-dd8b-4b16-a366-c4142dbafe4c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:10.804964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-98465c65-dd8b-4b16-a366-c4142dbafe4c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:10.805413 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-98465c65-dd8b-4b16-a366-c4142dbafe4c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:10.806195 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-98465c65-dd8b-4b16-a366-c4142dbafe4c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:10.806632 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-98465c65-dd8b-4b16-a366-c4142dbafe4c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:10.924801 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-234c2422-1c56-4b31-987b-5e7700d6d3f4 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:10.925417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-234c2422-1c56-4b31-987b-5e7700d6d3f4 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:10.931483 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-234c2422-1c56-4b31-987b-5e7700d6d3f4 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:10.931953 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-234c2422-1c56-4b31-987b-5e7700d6d3f4 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:10.932678 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-234c2422-1c56-4b31-987b-5e7700d6d3f4 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:10.933112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-234c2422-1c56-4b31-987b-5e7700d6d3f4 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:10.934530 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-98465c65-dd8b-4b16-a366-c4142dbafe4c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:10.942860 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-98465c65-dd8b-4b16-a366-c4142dbafe4c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1518 microversion: 2.1 time: 0.148730 Jul 12 17:37:10.943433 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 565/1099] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:10 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:10.948916 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=100 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:37:11.066733 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-234c2422-1c56-4b31-987b-5e7700d6d3f4 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:11.074014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-234c2422-1c56-4b31-987b-5e7700d6d3f4 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1266 microversion: 2.1 time: 0.153059 Jul 12 17:37:11.074580 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 535/1100] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:10 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:37:11.774725 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-01135965-e98c-4b5a-ae3c-4002fabfe70a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:11.775651 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-01135965-e98c-4b5a-ae3c-4002fabfe70a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:11.782341 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-01135965-e98c-4b5a-ae3c-4002fabfe70a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:11.782799 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-01135965-e98c-4b5a-ae3c-4002fabfe70a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:11.783560 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-01135965-e98c-4b5a-ae3c-4002fabfe70a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:11.784001 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-01135965-e98c-4b5a-ae3c-4002fabfe70a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:11.812447 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-01135965-e98c-4b5a-ae3c-4002fabfe70a tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041654 Jul 12 17:37:11.813092 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 566/1101] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:37:11 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:37:11.959000 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ce55eddc-1fa9-4c04-aed2-66eb4a25a4c6 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:11.959505 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ce55eddc-1fa9-4c04-aed2-66eb4a25a4c6 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:11.965996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ce55eddc-1fa9-4c04-aed2-66eb4a25a4c6 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:11.966439 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ce55eddc-1fa9-4c04-aed2-66eb4a25a4c6 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:11.967204 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ce55eddc-1fa9-4c04-aed2-66eb4a25a4c6 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:11.967633 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ce55eddc-1fa9-4c04-aed2-66eb4a25a4c6 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:12.090693 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3413a589-9371-4e01-8d5c-2ae8f1ba2176 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:12.091356 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3413a589-9371-4e01-8d5c-2ae8f1ba2176 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:12.094456 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ce55eddc-1fa9-4c04-aed2-66eb4a25a4c6 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:12.097268 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3413a589-9371-4e01-8d5c-2ae8f1ba2176 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:12.097749 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3413a589-9371-4e01-8d5c-2ae8f1ba2176 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:12.098534 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3413a589-9371-4e01-8d5c-2ae8f1ba2176 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:12.098970 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3413a589-9371-4e01-8d5c-2ae8f1ba2176 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:12.102096 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ce55eddc-1fa9-4c04-aed2-66eb4a25a4c6 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1518 microversion: 2.1 time: 0.147076 Jul 12 17:37:12.102660 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 536/1102] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:11 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1518 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:12.230936 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3413a589-9371-4e01-8d5c-2ae8f1ba2176 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:12.238609 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3413a589-9371-4e01-8d5c-2ae8f1ba2176 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1266 microversion: 2.1 time: 0.151722 Jul 12 17:37:12.239433 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 567/1103] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:12 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:37:12.824518 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b683248d-da1b-4ce0-bd11-5eb091f11df6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:12.825474 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b683248d-da1b-4ce0-bd11-5eb091f11df6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:12.831413 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b683248d-da1b-4ce0-bd11-5eb091f11df6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:12.831853 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b683248d-da1b-4ce0-bd11-5eb091f11df6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:12.832607 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b683248d-da1b-4ce0-bd11-5eb091f11df6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:12.833039 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b683248d-da1b-4ce0-bd11-5eb091f11df6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:12.864511 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b683248d-da1b-4ce0-bd11-5eb091f11df6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044000 Jul 12 17:37:12.865077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 537/1104] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:37:12 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:37:13.118982 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-200bf83a-0f2b-468c-9d6f-98c3662c737c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:13.119594 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-200bf83a-0f2b-468c-9d6f-98c3662c737c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:13.126079 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-200bf83a-0f2b-468c-9d6f-98c3662c737c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:13.126524 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-200bf83a-0f2b-468c-9d6f-98c3662c737c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:13.127285 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-200bf83a-0f2b-468c-9d6f-98c3662c737c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:13.127718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-200bf83a-0f2b-468c-9d6f-98c3662c737c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:13.254676 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-200bf83a-0f2b-468c-9d6f-98c3662c737c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:13.255465 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-703d9adf-05d4-4392-90be-33d99d61603f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:13.256081 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-703d9adf-05d4-4392-90be-33d99d61603f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:13.262157 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-200bf83a-0f2b-468c-9d6f-98c3662c737c tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1574 microversion: 2.1 time: 0.146983 Jul 12 17:37:13.262299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-703d9adf-05d4-4392-90be-33d99d61603f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:13.262605 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-703d9adf-05d4-4392-90be-33d99d61603f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:13.262715 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 568/1105] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:13 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:13.264038 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-703d9adf-05d4-4392-90be-33d99d61603f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:13.264485 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-703d9adf-05d4-4392-90be-33d99d61603f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:13.395076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-703d9adf-05d4-4392-90be-33d99d61603f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:13.402624 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-703d9adf-05d4-4392-90be-33d99d61603f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1266 microversion: 2.1 time: 0.150919 Jul 12 17:37:13.403183 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 538/1106] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:13 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:13.876586 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-56615f51-3151-4952-ae26-9c6de775f3da tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:13.877509 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-56615f51-3151-4952-ae26-9c6de775f3da tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:13.883489 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-56615f51-3151-4952-ae26-9c6de775f3da tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:13.883934 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-56615f51-3151-4952-ae26-9c6de775f3da tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:13.884686 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-56615f51-3151-4952-ae26-9c6de775f3da tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:13.885114 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-56615f51-3151-4952-ae26-9c6de775f3da tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:13.914534 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-56615f51-3151-4952-ae26-9c6de775f3da tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042516 Jul 12 17:37:13.915066 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 569/1107] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:37:13 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:37:14.279783 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2597f1c8-3176-405e-ae89-a61bb81c6b79 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:14.280405 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2597f1c8-3176-405e-ae89-a61bb81c6b79 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:14.286911 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2597f1c8-3176-405e-ae89-a61bb81c6b79 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:14.287370 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2597f1c8-3176-405e-ae89-a61bb81c6b79 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:14.288136 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2597f1c8-3176-405e-ae89-a61bb81c6b79 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:14.288570 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2597f1c8-3176-405e-ae89-a61bb81c6b79 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:14.420589 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4df90189-fb96-4919-95d7-e099fb187a6e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:14.421204 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4df90189-fb96-4919-95d7-e099fb187a6e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:14.421634 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2597f1c8-3176-405e-ae89-a61bb81c6b79 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:14.427986 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4df90189-fb96-4919-95d7-e099fb187a6e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:14.428422 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4df90189-fb96-4919-95d7-e099fb187a6e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:14.429192 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4df90189-fb96-4919-95d7-e099fb187a6e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:14.429709 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4df90189-fb96-4919-95d7-e099fb187a6e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:14.429820 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2597f1c8-3176-405e-ae89-a61bb81c6b79 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1574 microversion: 2.1 time: 0.154246 Jul 12 17:37:14.430483 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 539/1108] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:14 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:14.593781 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4df90189-fb96-4919-95d7-e099fb187a6e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:14.601172 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4df90189-fb96-4919-95d7-e099fb187a6e tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1266 microversion: 2.1 time: 0.184998 Jul 12 17:37:14.601748 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 570/1109] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:14 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:14.926442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-dccb39b2-005a-4956-aada-42581ccafa06 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:14.927296 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-dccb39b2-005a-4956-aada-42581ccafa06 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:14.933249 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dccb39b2-005a-4956-aada-42581ccafa06 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:14.933772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dccb39b2-005a-4956-aada-42581ccafa06 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:14.934492 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dccb39b2-005a-4956-aada-42581ccafa06 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:14.935428 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-dccb39b2-005a-4956-aada-42581ccafa06 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:14.964507 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-dccb39b2-005a-4956-aada-42581ccafa06 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042157 Jul 12 17:37:14.965086 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 540/1110] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:37:14 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:37:15.446676 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cf5b81ee-f053-4119-b724-6be3c6c7e567 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:15.447286 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cf5b81ee-f053-4119-b724-6be3c6c7e567 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:15.453614 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf5b81ee-f053-4119-b724-6be3c6c7e567 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:15.454133 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf5b81ee-f053-4119-b724-6be3c6c7e567 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:15.454869 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf5b81ee-f053-4119-b724-6be3c6c7e567 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:15.455322 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cf5b81ee-f053-4119-b724-6be3c6c7e567 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:15.588725 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-cf5b81ee-f053-4119-b724-6be3c6c7e567 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:15.596229 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cf5b81ee-f053-4119-b724-6be3c6c7e567 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1574 microversion: 2.1 time: 0.153513 Jul 12 17:37:15.596801 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 571/1111] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:15 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:15.617657 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e3c33f7d-8c48-44e6-8ce6-8255ad72c6ff tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:15.618423 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e3c33f7d-8c48-44e6-8ce6-8255ad72c6ff tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:15.625811 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e3c33f7d-8c48-44e6-8ce6-8255ad72c6ff tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:15.626125 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e3c33f7d-8c48-44e6-8ce6-8255ad72c6ff tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:15.626904 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e3c33f7d-8c48-44e6-8ce6-8255ad72c6ff tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:15.627362 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e3c33f7d-8c48-44e6-8ce6-8255ad72c6ff tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:15.756129 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e3c33f7d-8c48-44e6-8ce6-8255ad72c6ff tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:15.763564 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e3c33f7d-8c48-44e6-8ce6-8255ad72c6ff tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1266 microversion: 2.1 time: 0.149771 Jul 12 17:37:15.764131 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 541/1112] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:15 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:15.976105 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-64aa0439-d202-4bdb-af11-8f41b705f169 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:15.976954 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-64aa0439-d202-4bdb-af11-8f41b705f169 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:15.983582 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-64aa0439-d202-4bdb-af11-8f41b705f169 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:15.984032 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-64aa0439-d202-4bdb-af11-8f41b705f169 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:15.984786 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-64aa0439-d202-4bdb-af11-8f41b705f169 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:15.985223 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-64aa0439-d202-4bdb-af11-8f41b705f169 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:16.012807 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-64aa0439-d202-4bdb-af11-8f41b705f169 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040760 Jul 12 17:37:16.013346 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 572/1113] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:37:15 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:37:16.613207 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9eac9b8e-90bc-424c-adfb-93288112a027 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:16.613854 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9eac9b8e-90bc-424c-adfb-93288112a027 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:16.619813 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9eac9b8e-90bc-424c-adfb-93288112a027 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:16.620394 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9eac9b8e-90bc-424c-adfb-93288112a027 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:16.621016 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9eac9b8e-90bc-424c-adfb-93288112a027 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:16.621452 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9eac9b8e-90bc-424c-adfb-93288112a027 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:16.746624 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9eac9b8e-90bc-424c-adfb-93288112a027 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:16.754685 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9eac9b8e-90bc-424c-adfb-93288112a027 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1574 microversion: 2.1 time: 0.145268 Jul 12 17:37:16.755258 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 542/1114] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:16 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1574 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:16.780107 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-eaf6d237-4fa9-4232-a91f-d350817336ab tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:16.780720 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-eaf6d237-4fa9-4232-a91f-d350817336ab tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:16.787041 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eaf6d237-4fa9-4232-a91f-d350817336ab tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:16.787485 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eaf6d237-4fa9-4232-a91f-d350817336ab tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:16.788234 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eaf6d237-4fa9-4232-a91f-d350817336ab tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:16.788667 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eaf6d237-4fa9-4232-a91f-d350817336ab tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:16.916917 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-eaf6d237-4fa9-4232-a91f-d350817336ab tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:16.924922 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-eaf6d237-4fa9-4232-a91f-d350817336ab tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1266 microversion: 2.1 time: 0.148670 Jul 12 17:37:16.925482 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 573/1115] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:16 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:17.024359 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-70501a6f-c8b7-4f3d-9ee8-8b65f4b3ff13 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:17.025215 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-70501a6f-c8b7-4f3d-9ee8-8b65f4b3ff13 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:17.031207 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-70501a6f-c8b7-4f3d-9ee8-8b65f4b3ff13 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:17.031656 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-70501a6f-c8b7-4f3d-9ee8-8b65f4b3ff13 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:17.032425 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-70501a6f-c8b7-4f3d-9ee8-8b65f4b3ff13 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:17.032863 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-70501a6f-c8b7-4f3d-9ee8-8b65f4b3ff13 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:17.063167 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-70501a6f-c8b7-4f3d-9ee8-8b65f4b3ff13 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042812 Jul 12 17:37:17.063996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 543/1116] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:37:17 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:37:17.772441 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-dfb1c0f2-7140-4d3e-b8c6-7e857cbdd109 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:17.773052 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-dfb1c0f2-7140-4d3e-b8c6-7e857cbdd109 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:17.779027 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dfb1c0f2-7140-4d3e-b8c6-7e857cbdd109 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:17.780134 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dfb1c0f2-7140-4d3e-b8c6-7e857cbdd109 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:17.780885 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dfb1c0f2-7140-4d3e-b8c6-7e857cbdd109 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:17.781312 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-dfb1c0f2-7140-4d3e-b8c6-7e857cbdd109 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:17.911174 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-dfb1c0f2-7140-4d3e-b8c6-7e857cbdd109 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:17.918624 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-dfb1c0f2-7140-4d3e-b8c6-7e857cbdd109 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1574 microversion: 2.1 time: 0.150365 Jul 12 17:37:17.919182 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 574/1117] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:17 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:17.943504 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d23538b3-baab-4f4d-b2c3-6dd67afb41ce tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:17.944120 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d23538b3-baab-4f4d-b2c3-6dd67afb41ce tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:17.950632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d23538b3-baab-4f4d-b2c3-6dd67afb41ce tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:17.951127 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d23538b3-baab-4f4d-b2c3-6dd67afb41ce tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:17.952503 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d23538b3-baab-4f4d-b2c3-6dd67afb41ce tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:17.953155 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d23538b3-baab-4f4d-b2c3-6dd67afb41ce tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:18.074888 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-da67bcba-87e8-4c75-b6dd-3cf19e96c491 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:18.075918 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-da67bcba-87e8-4c75-b6dd-3cf19e96c491 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:18.082461 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-da67bcba-87e8-4c75-b6dd-3cf19e96c491 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:18.082914 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-da67bcba-87e8-4c75-b6dd-3cf19e96c491 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:18.083687 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-da67bcba-87e8-4c75-b6dd-3cf19e96c491 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:18.084119 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-da67bcba-87e8-4c75-b6dd-3cf19e96c491 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:18.085671 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d23538b3-baab-4f4d-b2c3-6dd67afb41ce tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:18.093020 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d23538b3-baab-4f4d-b2c3-6dd67afb41ce tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1266 microversion: 2.1 time: 0.154127 Jul 12 17:37:18.093592 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 544/1118] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:17 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:18.122299 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-da67bcba-87e8-4c75-b6dd-3cf19e96c491 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051269 Jul 12 17:37:18.123415 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 575/1119] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:37:18 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:37:18.936255 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2e4e1977-77d5-41d1-84e4-e19d11c5d9e5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:18.936880 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2e4e1977-77d5-41d1-84e4-e19d11c5d9e5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:18.943305 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2e4e1977-77d5-41d1-84e4-e19d11c5d9e5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:18.943811 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2e4e1977-77d5-41d1-84e4-e19d11c5d9e5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:18.945357 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2e4e1977-77d5-41d1-84e4-e19d11c5d9e5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:18.945859 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2e4e1977-77d5-41d1-84e4-e19d11c5d9e5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:19.075046 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2e4e1977-77d5-41d1-84e4-e19d11c5d9e5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:19.083098 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2e4e1977-77d5-41d1-84e4-e19d11c5d9e5 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1574 microversion: 2.1 time: 0.151792 Jul 12 17:37:19.083659 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 545/1120] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:18 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:19.109597 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ee9096cc-e454-4ba6-a890-a24d1d1352cb tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:19.110247 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ee9096cc-e454-4ba6-a890-a24d1d1352cb tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:19.116605 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ee9096cc-e454-4ba6-a890-a24d1d1352cb tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:19.117091 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ee9096cc-e454-4ba6-a890-a24d1d1352cb tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:19.117892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ee9096cc-e454-4ba6-a890-a24d1d1352cb tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:19.118332 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ee9096cc-e454-4ba6-a890-a24d1d1352cb tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:19.134287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4e0c1da7-ce02-487f-bf3b-2f59b3573bee tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:19.135220 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4e0c1da7-ce02-487f-bf3b-2f59b3573bee tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:19.141923 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4e0c1da7-ce02-487f-bf3b-2f59b3573bee tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:19.142731 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4e0c1da7-ce02-487f-bf3b-2f59b3573bee tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:19.143163 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4e0c1da7-ce02-487f-bf3b-2f59b3573bee tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:19.143605 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4e0c1da7-ce02-487f-bf3b-2f59b3573bee tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:19.177329 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4e0c1da7-ce02-487f-bf3b-2f59b3573bee tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046846 Jul 12 17:37:19.178122 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 546/1121] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:37:19 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 17:37:19.239078 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-81a868ed-899a-4880-9938-b8e5160a57b0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:19.239733 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-81a868ed-899a-4880-9938-b8e5160a57b0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:19.246012 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-81a868ed-899a-4880-9938-b8e5160a57b0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:19.246460 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-81a868ed-899a-4880-9938-b8e5160a57b0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:19.247263 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-81a868ed-899a-4880-9938-b8e5160a57b0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:19.247696 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-81a868ed-899a-4880-9938-b8e5160a57b0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:19.270834 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ee9096cc-e454-4ba6-a890-a24d1d1352cb tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:19.274069 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-81a868ed-899a-4880-9938-b8e5160a57b0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Going to try to terminate instance {{(pid=117939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:37:19.280037 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ee9096cc-e454-4ba6-a890-a24d1d1352cb tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1266 microversion: 2.1 time: 0.173685 Jul 12 17:37:19.280604 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 576/1122] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:19 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:19.348436 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-81a868ed-899a-4880-9938-b8e5160a57b0 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "DELETE /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 204 len: 0 microversion: 2.1 time: 0.114137 Jul 12 17:37:19.349014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 547/1123] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:37:19 2022] DELETE /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 17:37:19.357229 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-eb2f72a0-46ee-4a3e-a1e5-41494647e06f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:19.357991 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-eb2f72a0-46ee-4a3e-a1e5-41494647e06f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:19.363898 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eb2f72a0-46ee-4a3e-a1e5-41494647e06f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:19.364361 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eb2f72a0-46ee-4a3e-a1e5-41494647e06f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:19.365129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eb2f72a0-46ee-4a3e-a1e5-41494647e06f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:19.370215 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-eb2f72a0-46ee-4a3e-a1e5-41494647e06f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:19.496018 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-eb2f72a0-46ee-4a3e-a1e5-41494647e06f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:19.503906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-eb2f72a0-46ee-4a3e-a1e5-41494647e06f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1681 microversion: 2.1 time: 0.150682 Jul 12 17:37:19.504478 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 577/1124] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:19 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:20.101100 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-51c4a035-da9e-48aa-b874-a4242830eb5b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:20.101865 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-51c4a035-da9e-48aa-b874-a4242830eb5b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:20.108892 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-51c4a035-da9e-48aa-b874-a4242830eb5b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:20.109374 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-51c4a035-da9e-48aa-b874-a4242830eb5b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:20.110177 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-51c4a035-da9e-48aa-b874-a4242830eb5b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:20.110614 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-51c4a035-da9e-48aa-b874-a4242830eb5b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:20.246184 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-51c4a035-da9e-48aa-b874-a4242830eb5b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:20.253793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-51c4a035-da9e-48aa-b874-a4242830eb5b tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1574 microversion: 2.1 time: 0.157021 Jul 12 17:37:20.254377 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 548/1125] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:20 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:20.297457 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-680fca1b-1329-4eb4-8a2b-383650c53dee tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:20.298131 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-680fca1b-1329-4eb4-8a2b-383650c53dee tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:20.304584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-680fca1b-1329-4eb4-8a2b-383650c53dee tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:20.305035 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-680fca1b-1329-4eb4-8a2b-383650c53dee tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:20.305828 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-680fca1b-1329-4eb4-8a2b-383650c53dee tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:20.306260 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-680fca1b-1329-4eb4-8a2b-383650c53dee tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:20.439401 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-680fca1b-1329-4eb4-8a2b-383650c53dee tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:20.447239 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-680fca1b-1329-4eb4-8a2b-383650c53dee tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1266 microversion: 2.1 time: 0.154457 Jul 12 17:37:20.447812 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 578/1126] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:20 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:20.520920 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b0f572e9-bc74-426f-8d12-195ea5dff74d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:20.521534 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b0f572e9-bc74-426f-8d12-195ea5dff74d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:20.527491 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b0f572e9-bc74-426f-8d12-195ea5dff74d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:20.527948 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b0f572e9-bc74-426f-8d12-195ea5dff74d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:20.528707 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b0f572e9-bc74-426f-8d12-195ea5dff74d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:20.529640 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b0f572e9-bc74-426f-8d12-195ea5dff74d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:20.660846 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-b0f572e9-bc74-426f-8d12-195ea5dff74d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:20.668471 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b0f572e9-bc74-426f-8d12-195ea5dff74d tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1681 microversion: 2.1 time: 0.151405 Jul 12 17:37:20.669041 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 549/1127] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:20 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:21.271044 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-46fd052c-ccba-4f19-a858-8f8d29d8843f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:21.271695 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-46fd052c-ccba-4f19-a858-8f8d29d8843f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:21.277678 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-46fd052c-ccba-4f19-a858-8f8d29d8843f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:21.278155 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-46fd052c-ccba-4f19-a858-8f8d29d8843f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:21.278919 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-46fd052c-ccba-4f19-a858-8f8d29d8843f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:21.279355 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-46fd052c-ccba-4f19-a858-8f8d29d8843f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:21.411021 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-46fd052c-ccba-4f19-a858-8f8d29d8843f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:21.418303 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-abda6cfb-be7d-44d8-ae96-211ac097e55b req-63684514-c94a-4d04-ab81-3b02a45bf4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659c2528-8d70-483d-8fa3-dad061e504cb", "name": "network-vif-plugged", "status": "completed", "tag": "69957ac6-cba3-4a17-bf8c-7ef2a062fe49"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:37:21.418947 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-46fd052c-ccba-4f19-a858-8f8d29d8843f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1574 microversion: 2.1 time: 0.151741 Jul 12 17:37:21.428935 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 579/1128] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:21 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:21.429086 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-abda6cfb-be7d-44d8-ae96-211ac097e55b req-63684514-c94a-4d04-ab81-3b02a45bf4b3 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:21.429086 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-abda6cfb-be7d-44d8-ae96-211ac097e55b req-63684514-c94a-4d04-ab81-3b02a45bf4b3 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:21.439324 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-abda6cfb-be7d-44d8-ae96-211ac097e55b req-63684514-c94a-4d04-ab81-3b02a45bf4b3 service nova] Creating event network-vif-plugged:69957ac6-cba3-4a17-bf8c-7ef2a062fe49 for instance 659c2528-8d70-483d-8fa3-dad061e504cb on hv-cinder-84932 Jul 12 17:37:21.444013 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-abda6cfb-be7d-44d8-ae96-211ac097e55b req-63684514-c94a-4d04-ab81-3b02a45bf4b3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029240 Jul 12 17:37:21.444603 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 550/1129] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:37:21.463907 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-73b39aa2-8a8a-499b-bc4f-ed73f89ad1ab tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:21.464623 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-73b39aa2-8a8a-499b-bc4f-ed73f89ad1ab tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:21.470593 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-73b39aa2-8a8a-499b-bc4f-ed73f89ad1ab tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:21.471039 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-73b39aa2-8a8a-499b-bc4f-ed73f89ad1ab tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:21.471807 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-73b39aa2-8a8a-499b-bc4f-ed73f89ad1ab tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:21.472238 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-73b39aa2-8a8a-499b-bc4f-ed73f89ad1ab tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:21.604604 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-73b39aa2-8a8a-499b-bc4f-ed73f89ad1ab tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:21.612731 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-73b39aa2-8a8a-499b-bc4f-ed73f89ad1ab tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1266 microversion: 2.1 time: 0.152816 Jul 12 17:37:21.613277 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 580/1130] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:21 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:21.685318 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ab926eef-3fab-4ca9-8436-06c123e193fa tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:21.686064 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ab926eef-3fab-4ca9-8436-06c123e193fa tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:21.693141 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ab926eef-3fab-4ca9-8436-06c123e193fa tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:21.693595 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ab926eef-3fab-4ca9-8436-06c123e193fa tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:21.694394 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ab926eef-3fab-4ca9-8436-06c123e193fa tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:21.694838 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ab926eef-3fab-4ca9-8436-06c123e193fa tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:21.698858 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:37:21.826668 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ab926eef-3fab-4ca9-8436-06c123e193fa tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:21.834153 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ab926eef-3fab-4ca9-8436-06c123e193fa tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1681 microversion: 2.1 time: 0.153084 Jul 12 17:37:21.834722 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 551/1131] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:21 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:21.843493 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c8d1cffd-c474-4de0-9605-1e4ff4e16182 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:21.843994 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c8d1cffd-c474-4de0-9605-1e4ff4e16182 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:21.845844 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=82 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:37:21.850781 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c8d1cffd-c474-4de0-9605-1e4ff4e16182 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:21.851234 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c8d1cffd-c474-4de0-9605-1e4ff4e16182 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:21.851998 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c8d1cffd-c474-4de0-9605-1e4ff4e16182 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:21.852438 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c8d1cffd-c474-4de0-9605-1e4ff4e16182 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:21.856597 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=100 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:37:21.930387 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-c8d1cffd-c474-4de0-9605-1e4ff4e16182 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lazy-loading 'services' on Instance uuid 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:37:22.001001 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c8d1cffd-c474-4de0-9605-1e4ff4e16182 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc/os-volume_attachments/2e9c84a2-b7fa-411a-b340-df10a02533af" status: 202 len: 0 microversion: 2.1 time: 0.161297 Jul 12 17:37:22.001733 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 581/1132] 10.222.0.62 () {58 vars in 1415 bytes} [Tue Jul 12 17:37:21 2022] DELETE /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc/os-volume_attachments/2e9c84a2-b7fa-411a-b340-df10a02533af => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:37:22.436158 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-deb9d6e2-a6e6-4e5d-8cb8-bb4a119756db tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:22.436752 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-deb9d6e2-a6e6-4e5d-8cb8-bb4a119756db tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:22.444083 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-deb9d6e2-a6e6-4e5d-8cb8-bb4a119756db tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:22.444530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-deb9d6e2-a6e6-4e5d-8cb8-bb4a119756db tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:22.445295 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-deb9d6e2-a6e6-4e5d-8cb8-bb4a119756db tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:22.445756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-deb9d6e2-a6e6-4e5d-8cb8-bb4a119756db tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:22.571483 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-deb9d6e2-a6e6-4e5d-8cb8-bb4a119756db tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:22.578879 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-deb9d6e2-a6e6-4e5d-8cb8-bb4a119756db tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1574 microversion: 2.1 time: 0.146661 Jul 12 17:37:22.579434 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 552/1133] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:22 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:22.629898 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7e83fca9-c588-430b-b5b5-edf14f25ad2a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:22.630589 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7e83fca9-c588-430b-b5b5-edf14f25ad2a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:22.636679 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7e83fca9-c588-430b-b5b5-edf14f25ad2a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:22.637120 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7e83fca9-c588-430b-b5b5-edf14f25ad2a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:22.637906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7e83fca9-c588-430b-b5b5-edf14f25ad2a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:22.638339 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7e83fca9-c588-430b-b5b5-edf14f25ad2a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:22.768243 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-7e83fca9-c588-430b-b5b5-edf14f25ad2a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:22.775780 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7e83fca9-c588-430b-b5b5-edf14f25ad2a tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1266 microversion: 2.1 time: 0.151271 Jul 12 17:37:22.776349 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 582/1134] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:22 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:22.852160 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a3346487-8b7a-4951-9573-64486b1ab1f6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:22.852760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a3346487-8b7a-4951-9573-64486b1ab1f6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:22.859296 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a3346487-8b7a-4951-9573-64486b1ab1f6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:22.859745 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a3346487-8b7a-4951-9573-64486b1ab1f6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:22.860524 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a3346487-8b7a-4951-9573-64486b1ab1f6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:22.860956 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a3346487-8b7a-4951-9573-64486b1ab1f6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:22.987782 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a3346487-8b7a-4951-9573-64486b1ab1f6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:22.995933 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a3346487-8b7a-4951-9573-64486b1ab1f6 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1681 microversion: 2.1 time: 0.147866 Jul 12 17:37:22.996512 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 553/1135] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:22 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:23.595581 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a541e25a-ab1e-4d7d-83da-77636963edd4 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:23.596139 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a541e25a-ab1e-4d7d-83da-77636963edd4 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:23.602141 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a541e25a-ab1e-4d7d-83da-77636963edd4 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:23.602591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a541e25a-ab1e-4d7d-83da-77636963edd4 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:23.603351 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a541e25a-ab1e-4d7d-83da-77636963edd4 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:23.603984 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a541e25a-ab1e-4d7d-83da-77636963edd4 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:23.792458 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2f26ecd5-9d94-4a9a-96e1-ce9d36f71de5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:23.793049 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2f26ecd5-9d94-4a9a-96e1-ce9d36f71de5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:23.799870 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2f26ecd5-9d94-4a9a-96e1-ce9d36f71de5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:23.800327 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2f26ecd5-9d94-4a9a-96e1-ce9d36f71de5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:23.801088 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2f26ecd5-9d94-4a9a-96e1-ce9d36f71de5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:23.801517 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2f26ecd5-9d94-4a9a-96e1-ce9d36f71de5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:24.131184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a541e25a-ab1e-4d7d-83da-77636963edd4 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:24.143328 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a541e25a-ab1e-4d7d-83da-77636963edd4 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1574 microversion: 2.1 time: 0.551430 Jul 12 17:37:24.144193 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 583/1136] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:23 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1574 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:24.149108 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-07aaaebc-1839-4d9a-abfe-02b7073ca1af tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:24.152866 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-07aaaebc-1839-4d9a-abfe-02b7073ca1af tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:24.169358 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-07aaaebc-1839-4d9a-abfe-02b7073ca1af tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:24.170159 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-07aaaebc-1839-4d9a-abfe-02b7073ca1af tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:24.172741 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-07aaaebc-1839-4d9a-abfe-02b7073ca1af tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:24.174774 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-07aaaebc-1839-4d9a-abfe-02b7073ca1af tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:24.180834 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2f26ecd5-9d94-4a9a-96e1-ce9d36f71de5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:24.195425 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2f26ecd5-9d94-4a9a-96e1-ce9d36f71de5 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1266 microversion: 2.1 time: 0.406754 Jul 12 17:37:24.196009 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 554/1137] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:23 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1266 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:37:24.425330 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-07aaaebc-1839-4d9a-abfe-02b7073ca1af tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:24.433011 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-07aaaebc-1839-4d9a-abfe-02b7073ca1af tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1681 microversion: 2.1 time: 0.287593 Jul 12 17:37:24.433618 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 584/1138] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:24 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1681 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:24.934561 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-03aa2105-d5d1-488b-bae1-c4ae4c9f3faf req-9834220e-88e4-4dbb-82be-2a7d3f094920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e50bdd-3716-421f-b6ca-832ee1f63c42", "name": "network-vif-deleted", "tag": "252a7740-2a5f-4b94-9778-971825115baf"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:37:24.943788 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-03aa2105-d5d1-488b-bae1-c4ae4c9f3faf req-9834220e-88e4-4dbb-82be-2a7d3f094920 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:24.944229 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-03aa2105-d5d1-488b-bae1-c4ae4c9f3faf req-9834220e-88e4-4dbb-82be-2a7d3f094920 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:24.955102 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-03aa2105-d5d1-488b-bae1-c4ae4c9f3faf req-9834220e-88e4-4dbb-82be-2a7d3f094920 service nova] Creating event network-vif-deleted:252a7740-2a5f-4b94-9778-971825115baf for instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 on hv-cinder-84932 Jul 12 17:37:24.960346 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-03aa2105-d5d1-488b-bae1-c4ae4c9f3faf req-9834220e-88e4-4dbb-82be-2a7d3f094920 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029424 Jul 12 17:37:24.960927 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 555/1139] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:37:25.160988 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f6d6bfe3-87cd-47bd-b004-8b891c8c0aae tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:25.161601 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f6d6bfe3-87cd-47bd-b004-8b891c8c0aae tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:25.168810 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f6d6bfe3-87cd-47bd-b004-8b891c8c0aae tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:25.169262 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f6d6bfe3-87cd-47bd-b004-8b891c8c0aae tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:25.170076 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f6d6bfe3-87cd-47bd-b004-8b891c8c0aae tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:25.170516 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f6d6bfe3-87cd-47bd-b004-8b891c8c0aae tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:25.212859 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-60e87c75-2867-47e2-a1af-47d8a5b7f7e8 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:25.213577 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-60e87c75-2867-47e2-a1af-47d8a5b7f7e8 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:25.223118 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-60e87c75-2867-47e2-a1af-47d8a5b7f7e8 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:25.223802 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-60e87c75-2867-47e2-a1af-47d8a5b7f7e8 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:25.224770 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-60e87c75-2867-47e2-a1af-47d8a5b7f7e8 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:25.225389 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-60e87c75-2867-47e2-a1af-47d8a5b7f7e8 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:25.366605 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-f6d6bfe3-87cd-47bd-b004-8b891c8c0aae tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:25.374038 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f6d6bfe3-87cd-47bd-b004-8b891c8c0aae tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1574 microversion: 2.1 time: 0.216996 Jul 12 17:37:25.375341 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 585/1140] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:25 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1574 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:25.380216 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-25941ff7-5322-4baf-9418-38b2d101af64 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:25.380723 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-25941ff7-5322-4baf-9418-38b2d101af64 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:25.387011 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-25941ff7-5322-4baf-9418-38b2d101af64 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:25.387465 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-25941ff7-5322-4baf-9418-38b2d101af64 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:25.388235 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-25941ff7-5322-4baf-9418-38b2d101af64 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:25.388668 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-25941ff7-5322-4baf-9418-38b2d101af64 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:25.397360 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-60e87c75-2867-47e2-a1af-47d8a5b7f7e8 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:25.405578 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-60e87c75-2867-47e2-a1af-47d8a5b7f7e8 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1266 microversion: 2.1 time: 0.196892 Jul 12 17:37:25.414930 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 556/1141] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:25 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:37:25.415107 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-25941ff7-5322-4baf-9418-38b2d101af64 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:37:25.452496 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-762687d5-d507-48ec-b79a-e4ac50f83fa9 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:25.453307 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-762687d5-d507-48ec-b79a-e4ac50f83fa9 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:25.460867 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-762687d5-d507-48ec-b79a-e4ac50f83fa9 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:25.461954 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-762687d5-d507-48ec-b79a-e4ac50f83fa9 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:25.463079 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-762687d5-d507-48ec-b79a-e4ac50f83fa9 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:25.463789 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-762687d5-d507-48ec-b79a-e4ac50f83fa9 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:25.500274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-25941ff7-5322-4baf-9418-38b2d101af64 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 204 len: 0 microversion: 2.1 time: 0.122851 Jul 12 17:37:25.501402 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 586/1142] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:37:25 2022] DELETE /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:37:25.519344 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e0b164ec-57d8-4d8e-a187-ce2169f207bf tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:25.520112 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e0b164ec-57d8-4d8e-a187-ce2169f207bf tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:25.527800 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0b164ec-57d8-4d8e-a187-ce2169f207bf tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:25.528402 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0b164ec-57d8-4d8e-a187-ce2169f207bf tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:25.529174 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0b164ec-57d8-4d8e-a187-ce2169f207bf tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:25.530064 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e0b164ec-57d8-4d8e-a187-ce2169f207bf tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:25.559418 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-762687d5-d507-48ec-b79a-e4ac50f83fa9 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:25.577027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-762687d5-d507-48ec-b79a-e4ac50f83fa9 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1613 microversion: 2.1 time: 0.129473 Jul 12 17:37:25.578047 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 557/1143] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:25 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1613 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:37:25.681993 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-e0b164ec-57d8-4d8e-a187-ce2169f207bf tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:25.690764 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e0b164ec-57d8-4d8e-a187-ce2169f207bf tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1511 microversion: 2.1 time: 0.180406 Jul 12 17:37:25.691338 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 587/1144] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:25 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:25.857287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-047f3ed8-fbaa-4db1-b51f-59f6b04726f4 req-d6318aec-7c94-4575-80ff-48eec4343369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdfd07ca-55f6-48b2-b2c7-f202196e05ed", "name": "network-vif-plugged", "status": "completed", "tag": "78ee797f-f3e0-4e02-ba3d-1c9755d72b65"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:37:25.867628 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-047f3ed8-fbaa-4db1-b51f-59f6b04726f4 req-d6318aec-7c94-4575-80ff-48eec4343369 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:25.868166 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-047f3ed8-fbaa-4db1-b51f-59f6b04726f4 req-d6318aec-7c94-4575-80ff-48eec4343369 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:25.880977 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-047f3ed8-fbaa-4db1-b51f-59f6b04726f4 req-d6318aec-7c94-4575-80ff-48eec4343369 service nova] Creating event network-vif-plugged:78ee797f-f3e0-4e02-ba3d-1c9755d72b65 for instance bdfd07ca-55f6-48b2-b2c7-f202196e05ed on hv-cinder-84932 Jul 12 17:37:25.885941 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-047f3ed8-fbaa-4db1-b51f-59f6b04726f4 req-d6318aec-7c94-4575-80ff-48eec4343369 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032434 Jul 12 17:37:25.886703 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 558/1145] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:37:26.390913 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b9db7dea-1242-440d-8085-f414f5d609b6 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:26.391532 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b9db7dea-1242-440d-8085-f414f5d609b6 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:26.398015 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9db7dea-1242-440d-8085-f414f5d609b6 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:26.398477 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9db7dea-1242-440d-8085-f414f5d609b6 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:26.399259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9db7dea-1242-440d-8085-f414f5d609b6 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:26.399699 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b9db7dea-1242-440d-8085-f414f5d609b6 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:26.423776 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a6d564dd-b422-4909-979e-2437a79c4fc6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:26.424607 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a6d564dd-b422-4909-979e-2437a79c4fc6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:26.430772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a6d564dd-b422-4909-979e-2437a79c4fc6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:26.431231 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a6d564dd-b422-4909-979e-2437a79c4fc6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:26.432002 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a6d564dd-b422-4909-979e-2437a79c4fc6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:26.432440 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a6d564dd-b422-4909-979e-2437a79c4fc6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:26.585529 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-b9db7dea-1242-440d-8085-f414f5d609b6 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:26.593530 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b9db7dea-1242-440d-8085-f414f5d609b6 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1574 microversion: 2.1 time: 0.206942 Jul 12 17:37:26.594223 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 588/1146] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:26 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1574 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:26.598732 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4ce0257c-6a14-4e18-9b3e-2eb31194ba24 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:26.599345 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4ce0257c-6a14-4e18-9b3e-2eb31194ba24 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:26.605247 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ce0257c-6a14-4e18-9b3e-2eb31194ba24 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:26.605753 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ce0257c-6a14-4e18-9b3e-2eb31194ba24 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:26.606608 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ce0257c-6a14-4e18-9b3e-2eb31194ba24 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:26.607052 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4ce0257c-6a14-4e18-9b3e-2eb31194ba24 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:26.612970 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a6d564dd-b422-4909-979e-2437a79c4fc6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:26.620373 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a6d564dd-b422-4909-979e-2437a79c4fc6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1266 microversion: 2.1 time: 0.201390 Jul 12 17:37:26.621170 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 559/1147] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:26 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:37:26.667984 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-4ce0257c-6a14-4e18-9b3e-2eb31194ba24 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:26.675261 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4ce0257c-6a14-4e18-9b3e-2eb31194ba24 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1325 microversion: 2.1 time: 0.080029 Jul 12 17:37:26.675826 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 589/1148] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:26 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1325 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:26.707966 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a633ec0c-d143-42ca-90a8-a4b82982cdf0 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:26.708584 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a633ec0c-d143-42ca-90a8-a4b82982cdf0 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:26.714585 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a633ec0c-d143-42ca-90a8-a4b82982cdf0 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:26.715025 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a633ec0c-d143-42ca-90a8-a4b82982cdf0 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:26.715793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a633ec0c-d143-42ca-90a8-a4b82982cdf0 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:26.716230 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a633ec0c-d143-42ca-90a8-a4b82982cdf0 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:26.847970 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a633ec0c-d143-42ca-90a8-a4b82982cdf0 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:26.855425 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a633ec0c-d143-42ca-90a8-a4b82982cdf0 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1511 microversion: 2.1 time: 0.151284 Jul 12 17:37:26.855997 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 560/1149] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:26 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:27.609942 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-41afad94-303d-440b-90ac-9a25cbfdd568 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:27.610544 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-41afad94-303d-440b-90ac-9a25cbfdd568 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:27.616982 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41afad94-303d-440b-90ac-9a25cbfdd568 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:27.617422 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41afad94-303d-440b-90ac-9a25cbfdd568 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:27.618208 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41afad94-303d-440b-90ac-9a25cbfdd568 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:27.618636 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41afad94-303d-440b-90ac-9a25cbfdd568 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:27.637633 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1ceb15e4-10a8-40db-8f3e-fb8a63513267 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:27.638356 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1ceb15e4-10a8-40db-8f3e-fb8a63513267 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:27.645309 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1ceb15e4-10a8-40db-8f3e-fb8a63513267 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:27.645795 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1ceb15e4-10a8-40db-8f3e-fb8a63513267 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:27.646570 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1ceb15e4-10a8-40db-8f3e-fb8a63513267 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:27.647011 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1ceb15e4-10a8-40db-8f3e-fb8a63513267 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:27.800553 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-41afad94-303d-440b-90ac-9a25cbfdd568 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:27.808174 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-41afad94-303d-440b-90ac-9a25cbfdd568 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1574 microversion: 2.1 time: 0.202262 Jul 12 17:37:27.809085 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 590/1150] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:27 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1574 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:27.814469 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-fe37fd98-530f-4621-b09b-97343fc338da tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:27.815077 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-fe37fd98-530f-4621-b09b-97343fc338da tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:27.820925 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe37fd98-530f-4621-b09b-97343fc338da tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:27.821371 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe37fd98-530f-4621-b09b-97343fc338da tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:27.822186 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe37fd98-530f-4621-b09b-97343fc338da tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:27.822605 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe37fd98-530f-4621-b09b-97343fc338da tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:27.824822 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1ceb15e4-10a8-40db-8f3e-fb8a63513267 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:27.832361 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1ceb15e4-10a8-40db-8f3e-fb8a63513267 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1453 microversion: 2.1 time: 0.198549 Jul 12 17:37:27.832933 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 561/1151] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:27 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1453 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:37:27.848063 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2402d11d-d410-4449-b3d6-9ea53c4ee2fd tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:27.848704 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2402d11d-d410-4449-b3d6-9ea53c4ee2fd tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:27.854533 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2402d11d-d410-4449-b3d6-9ea53c4ee2fd tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:27.854911 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe37fd98-530f-4621-b09b-97343fc338da tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:27.855045 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2402d11d-d410-4449-b3d6-9ea53c4ee2fd tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:27.855356 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-fe37fd98-530f-4621-b09b-97343fc338da tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:27.855741 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2402d11d-d410-4449-b3d6-9ea53c4ee2fd tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:27.855846 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-fe37fd98-530f-4621-b09b-97343fc338da tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lazy-loading 'fault' on Instance uuid 88e50bdd-3716-421f-b6ca-832ee1f63c42 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:37:27.856186 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2402d11d-d410-4449-b3d6-9ea53c4ee2fd tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:27.901630 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-fe37fd98-530f-4621-b09b-97343fc338da tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a74ebdd59a491386aedcdbd312b363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4e837b171b4b4a9c2ad230cda53452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:27.909222 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-fe37fd98-530f-4621-b09b-97343fc338da tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 200 len: 1330 microversion: 2.1 time: 0.099158 Jul 12 17:37:27.909816 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 591/1152] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:27 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 1330 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:27.914264 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9889922d-54ec-419c-850d-a164fe93dcab tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:27.914869 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9889922d-54ec-419c-850d-a164fe93dcab tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:27.921653 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9889922d-54ec-419c-850d-a164fe93dcab tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:27.922132 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9889922d-54ec-419c-850d-a164fe93dcab tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:27.922890 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9889922d-54ec-419c-850d-a164fe93dcab tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:27.923320 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9889922d-54ec-419c-850d-a164fe93dcab tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:28.036215 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2402d11d-d410-4449-b3d6-9ea53c4ee2fd tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:28.044531 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2402d11d-d410-4449-b3d6-9ea53c4ee2fd tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1453 microversion: 2.1 time: 0.200122 Jul 12 17:37:28.045392 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 562/1153] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:27 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1453 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:37:28.080175 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9889922d-54ec-419c-850d-a164fe93dcab tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:28.087791 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9889922d-54ec-419c-850d-a164fe93dcab tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1511 microversion: 2.1 time: 0.177027 Jul 12 17:37:28.088348 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 592/1154] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:27 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:28.828231 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-63b1704c-4a7d-4565-9710-4e9eb9cee614 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:28.829547 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-63b1704c-4a7d-4565-9710-4e9eb9cee614 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:28.836706 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-63b1704c-4a7d-4565-9710-4e9eb9cee614 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:28.837787 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-63b1704c-4a7d-4565-9710-4e9eb9cee614 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:28.837936 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-63b1704c-4a7d-4565-9710-4e9eb9cee614 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:28.838376 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-63b1704c-4a7d-4565-9710-4e9eb9cee614 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:28.926730 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e60778af-3bc2-4e98-b035-1356913b4034 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:28.928017 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e60778af-3bc2-4e98-b035-1356913b4034 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:28.934979 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e60778af-3bc2-4e98-b035-1356913b4034 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:28.935433 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e60778af-3bc2-4e98-b035-1356913b4034 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:28.936216 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e60778af-3bc2-4e98-b035-1356913b4034 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:28.937324 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e60778af-3bc2-4e98-b035-1356913b4034 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:28.952809 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-e60778af-3bc2-4e98-b035-1356913b4034 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] HTTP exception thrown: Instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 could not be found. Jul 12 17:37:28.954497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e60778af-3bc2-4e98-b035-1356913b4034 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Request method failure captured: Jul 12 17:37:28.954497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 HTTP/1.1 Jul 12 17:37:28.954497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:37:28.954497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:37:28.954497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:37:28.954497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:37:28.954497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:37:28.954497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:37:28.954497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:37:28.954497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:37:28.954497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza6s95YbmpHGEF6KuEgm1a_bLJ81FwTpSTIH7MTxyWuinNdKpad_B8P_UZWneUdxW68SGH3Srj8_vZq-CuSnlwKSv16guwMSxTDbOGQyNs0XrVu8KfhrnvEOXIz2ODhAC95eTPACdOrc6qWclLz7G-TtlizrY4gQ1jWkpckM6H1sbeY Jul 12 17:37:28.954497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:37:28.954497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:37:28.954497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:37:28.954497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:37:28.954497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:37:28.954497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:37:28.954497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:37:28.954497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:28.954497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:37:28.954497 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:37:28.955937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4a4e837b171b4b4a9c2ad230cda53452", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:37:28.955937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:28.955937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:37:28.955937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:28.955937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:37:28.955937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:37:28.955937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:37:28.955937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: 38a74ebdd59a491386aedcdbd312b363 Jul 12 17:37:28.955937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:37:28.955937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:37:28.955937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 could not be found. Jul 12 17:37:28.955937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': '88e50bdd-3716-421f-b6ca-832ee1f63c42'} Jul 12 17:37:28.956870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:37:28.956870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:28.956870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:37:28.956870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:37:28.956870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:37:28.956870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:37:28.956870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:37:28.956870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:37:28.956870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:37:28.956870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:37:28.956870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 could not be found. Jul 12 17:37:28.956870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:28.956870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:37:28.956870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:28.956870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:28.956870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:37:28.956870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:37:28.956870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:37:28.956870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:37:28.956870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:37:28.959737 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:37:28.959737 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:37:28.959737 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:37:28.959737 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:37:28.959737 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:37:28.959737 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:37:28.959737 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:37:28.959737 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 could not be found. Jul 12 17:37:28.959737 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:28.959737 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:37:28.959737 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:28.959737 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:28.959737 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:37:28.959737 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:37:28.959737 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:37:28.959737 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:37:28.959737 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 could not be found. Jul 12 17:37:28.959737 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:28.964361 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e60778af-3bc2-4e98-b035-1356913b4034 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Returning 404 to user: Instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:37:28.964361 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e60778af-3bc2-4e98-b035-1356913b4034 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 404 len: 111 microversion: 2.1 time: 0.033289 Jul 12 17:37:28.964361 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 593/1155] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:28 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:37:28.966220 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d5525bd6-4be0-4e2f-b153-e80c3eaa9b92 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '.version_select at 0x7f872e1b2b80>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:28.985651 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d5525bd6-4be0-4e2f-b153-e80c3eaa9b92 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-837305579" status: 202 len: 0 microversion: 2.1 time: 0.023767 Jul 12 17:37:28.986331 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 594/1156] 10.222.0.62 () {58 vars in 1217 bytes} [Tue Jul 12 17:37:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-837305579 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:37:29.045374 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-63b1704c-4a7d-4565-9710-4e9eb9cee614 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:29.053117 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-63b1704c-4a7d-4565-9710-4e9eb9cee614 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1574 microversion: 2.1 time: 0.231040 Jul 12 17:37:29.053988 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 563/1157] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:28 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1574 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:29.104438 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-09977642-bafe-4420-a75d-d91f7919b770 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:29.105217 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-09977642-bafe-4420-a75d-d91f7919b770 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:29.111809 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-09977642-bafe-4420-a75d-d91f7919b770 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:29.112261 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-09977642-bafe-4420-a75d-d91f7919b770 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:29.113028 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-09977642-bafe-4420-a75d-d91f7919b770 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:29.114110 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-09977642-bafe-4420-a75d-d91f7919b770 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:29.208606 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-09977642-bafe-4420-a75d-d91f7919b770 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:29.216990 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-09977642-bafe-4420-a75d-d91f7919b770 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1469 microversion: 2.1 time: 0.116429 Jul 12 17:37:29.217627 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 595/1158] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:29 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1469 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:29.262981 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-08a90996-9b74-4038-b5ff-b95569f45a1b req-203e02a8-8d6f-408b-855c-2b664ceefee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc", "name": "network-vif-deleted", "tag": "2c4d18f3-2927-4e38-8f30-cd7cb5755c6e"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:37:29.273578 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-08a90996-9b74-4038-b5ff-b95569f45a1b req-203e02a8-8d6f-408b-855c-2b664ceefee6 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:29.274608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-08a90996-9b74-4038-b5ff-b95569f45a1b req-203e02a8-8d6f-408b-855c-2b664ceefee6 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:29.287101 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-08a90996-9b74-4038-b5ff-b95569f45a1b req-203e02a8-8d6f-408b-855c-2b664ceefee6 service nova] Creating event network-vif-deleted:2c4d18f3-2927-4e38-8f30-cd7cb5755c6e for instance 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc on hv-cinder-84932 Jul 12 17:37:29.292375 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-08a90996-9b74-4038-b5ff-b95569f45a1b req-203e02a8-8d6f-408b-855c-2b664ceefee6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033311 Jul 12 17:37:29.293176 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 564/1159] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:37:30.071306 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-aa71bcfa-9cbf-405b-baa9-5cde5ccaf930 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:30.071917 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-aa71bcfa-9cbf-405b-baa9-5cde5ccaf930 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:30.079402 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aa71bcfa-9cbf-405b-baa9-5cde5ccaf930 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:30.079928 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aa71bcfa-9cbf-405b-baa9-5cde5ccaf930 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:30.080772 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aa71bcfa-9cbf-405b-baa9-5cde5ccaf930 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:30.081301 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-aa71bcfa-9cbf-405b-baa9-5cde5ccaf930 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:30.223061 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-aa71bcfa-9cbf-405b-baa9-5cde5ccaf930 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:30.225488 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:37:30.233404 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-aa71bcfa-9cbf-405b-baa9-5cde5ccaf930 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1574 microversion: 2.1 time: 0.166014 Jul 12 17:37:30.243020 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-58694a15-534c-4bde-be91-d55ded52be76 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:30.243700 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 596/1160] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:30 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:30.243795 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-58694a15-534c-4bde-be91-d55ded52be76 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:30.245962 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-58694a15-534c-4bde-be91-d55ded52be76 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:30.246602 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-58694a15-534c-4bde-be91-d55ded52be76 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:30.247688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-58694a15-534c-4bde-be91-d55ded52be76 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:30.248125 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-58694a15-534c-4bde-be91-d55ded52be76 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:30.282818 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-58694a15-534c-4bde-be91-d55ded52be76 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:30.283262 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-58694a15-534c-4bde-be91-d55ded52be76 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:30.283712 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-58694a15-534c-4bde-be91-d55ded52be76 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lazy-loading 'fault' on Instance uuid 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:37:30.325066 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-58694a15-534c-4bde-be91-d55ded52be76 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '486e09fa46b8483aa1a0e38de1b70958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8791892016f411b83948dcc36e4b243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:30.333711 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-58694a15-534c-4bde-be91-d55ded52be76 tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 200 len: 1308 microversion: 2.1 time: 0.103622 Jul 12 17:37:30.334295 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 565/1161] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:30 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:30.560988 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-f9e72bda-4692-4955-8c5c-b3b763455bb2 req-c9e4e396-3cc6-4871-a11c-83d70d0008b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659c2528-8d70-483d-8fa3-dad061e504cb", "tag": "69957ac6-cba3-4a17-bf8c-7ef2a062fe49"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:37:30.570356 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-f9e72bda-4692-4955-8c5c-b3b763455bb2 req-c9e4e396-3cc6-4871-a11c-83d70d0008b1 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:30.570884 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-f9e72bda-4692-4955-8c5c-b3b763455bb2 req-c9e4e396-3cc6-4871-a11c-83d70d0008b1 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:30.582565 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-f9e72bda-4692-4955-8c5c-b3b763455bb2 req-c9e4e396-3cc6-4871-a11c-83d70d0008b1 service nova] Creating event network-changed:69957ac6-cba3-4a17-bf8c-7ef2a062fe49 for instance 659c2528-8d70-483d-8fa3-dad061e504cb on hv-cinder-84932 Jul 12 17:37:30.587683 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-f9e72bda-4692-4955-8c5c-b3b763455bb2 req-c9e4e396-3cc6-4871-a11c-83d70d0008b1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107851 Jul 12 17:37:30.588276 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 597/1162] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:37:31.250723 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c7621192-ab7d-4e72-85db-66054c9a3f68 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:31.251345 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c7621192-ab7d-4e72-85db-66054c9a3f68 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:31.258028 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c7621192-ab7d-4e72-85db-66054c9a3f68 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:31.258483 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c7621192-ab7d-4e72-85db-66054c9a3f68 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:31.259271 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c7621192-ab7d-4e72-85db-66054c9a3f68 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:31.259710 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c7621192-ab7d-4e72-85db-66054c9a3f68 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:31.352329 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-15aa0cad-eb46-4990-90f9-aa70311056fc tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:31.353947 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-15aa0cad-eb46-4990-90f9-aa70311056fc tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] [instance: 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:31.362042 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15aa0cad-eb46-4990-90f9-aa70311056fc tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:31.362759 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15aa0cad-eb46-4990-90f9-aa70311056fc tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:31.363610 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15aa0cad-eb46-4990-90f9-aa70311056fc tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:31.364043 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-15aa0cad-eb46-4990-90f9-aa70311056fc tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:31.379191 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-15aa0cad-eb46-4990-90f9-aa70311056fc tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] HTTP exception thrown: Instance 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc could not be found. Jul 12 17:37:31.381227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-15aa0cad-eb46-4990-90f9-aa70311056fc tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Request method failure captured: Jul 12 17:37:31.381227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc HTTP/1.1 Jul 12 17:37:31.381227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:37:31.381227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:37:31.381227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:37:31.381227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:37:31.381227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:37:31.381227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:37:31.381227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:37:31.381227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:37:31.381227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizbDBcJz86alQYAVb9p_LcnmK8g0EspkDVYig1JqMpgS1e1IPXGIdQkVkwmKIWMsH_HYA1xJ8NfhFBZlcyHUooQzViWAbOl6olSWODt6UEqXFuayDtFnpiuCoAMxoAD0mGDZe0Y7UV5yt_PL550gfXeUNlTjgy6xUihlACzdYFacLITA Jul 12 17:37:31.381227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:37:31.381227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:37:31.381227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:37:31.381227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:37:31.381227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:37:31.381227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:37:31.381227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: a8791892016f411b83948dcc36e4b243 Jul 12 17:37:31.381227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2107844421 Jul 12 17:37:31.381227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:37:31.381227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:37:31.383039 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a8791892016f411b83948dcc36e4b243"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a8791892016f411b83948dcc36e4b243"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a8791892016f411b83948dcc36e4b243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a8791892016f411b83948dcc36e4b243", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:37:31.383039 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-VolumesSnapshotTestJSON-2107844421 Jul 12 17:37:31.383039 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: a8791892016f411b83948dcc36e4b243 Jul 12 17:37:31.383039 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2107844421 Jul 12 17:37:31.383039 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-VolumesSnapshotTestJSON-2107844421-project Jul 12 17:37:31.383039 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:37:31.383039 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:37:31.383039 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: 486e09fa46b8483aa1a0e38de1b70958 Jul 12 17:37:31.383039 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-VolumesSnapshotTestJSON-2107844421-project Jul 12 17:37:31.383039 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:37:31.383039 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Instance 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc could not be found. Jul 12 17:37:31.383039 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': '3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc'} Jul 12 17:37:31.384004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:37:31.384004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:31.384004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:37:31.384004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:37:31.384004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:37:31.384004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:37:31.384004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:37:31.384004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:37:31.384004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:37:31.384004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:37:31.384004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc could not be found. Jul 12 17:37:31.384004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:31.384004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:37:31.384004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:31.384004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:31.384004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:37:31.384004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:37:31.384004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:37:31.384004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:37:31.384004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:37:31.385580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:37:31.385580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:37:31.385580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:37:31.385580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:37:31.385580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:37:31.385580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:37:31.385580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:37:31.385580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc could not be found. Jul 12 17:37:31.385580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:31.385580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:37:31.385580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:31.385580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:31.385580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:37:31.385580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:37:31.385580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:37:31.385580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:37:31.385580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc could not be found. Jul 12 17:37:31.385580 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:31.388127 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-15aa0cad-eb46-4990-90f9-aa70311056fc tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] Returning 404 to user: Instance 3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:37:31.389325 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-15aa0cad-eb46-4990-90f9-aa70311056fc tempest-VolumesSnapshotTestJSON-2107844421 tempest-VolumesSnapshotTestJSON-2107844421-project] 10.222.0.62 "GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc" status: 404 len: 111 microversion: 2.1 time: 0.042348 Jul 12 17:37:31.390589 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 598/1163] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:31 2022] GET /compute/v2.1/servers/3e7f0a1b-f70e-42e0-a474-6ed8c0b7c4cc => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:37:31.505819 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c7621192-ab7d-4e72-85db-66054c9a3f68 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:37:31.513453 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c7621192-ab7d-4e72-85db-66054c9a3f68 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1561 microversion: 2.1 time: 0.266582 Jul 12 17:37:31.514010 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 566/1164] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:31 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1561 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:37:31.519850 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cd4a55d3-0b0b-430d-8098-b4b0b2763c70 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:31.521067 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cd4a55d3-0b0b-430d-8098-b4b0b2763c70 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:31.531544 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd4a55d3-0b0b-430d-8098-b4b0b2763c70 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:31.532421 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd4a55d3-0b0b-430d-8098-b4b0b2763c70 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:31.534624 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd4a55d3-0b0b-430d-8098-b4b0b2763c70 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:31.535094 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cd4a55d3-0b0b-430d-8098-b4b0b2763c70 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:31.554216 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-cd4a55d3-0b0b-430d-8098-b4b0b2763c70 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] HTTP exception thrown: Instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 could not be found. Jul 12 17:37:31.556097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cd4a55d3-0b0b-430d-8098-b4b0b2763c70 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Request method failure captured: Jul 12 17:37:31.556097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 HTTP/1.1 Jul 12 17:37:31.556097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:37:31.556097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:37:31.556097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:37:31.556097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:37:31.556097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:37:31.556097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:37:31.556097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:37:31.556097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:37:31.556097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza6s95YbmpHGEF6KuEgm1a_bLJ81FwTpSTIH7MTxyWuinNdKpad_B8P_UZWneUdxW68SGH3Srj8_vZq-CuSnlwKSv16guwMSxTDbOGQyNs0XrVu8KfhrnvEOXIz2ODhAC95eTPACdOrc6qWclLz7G-TtlizrY4gQ1jWkpckM6H1sbeY Jul 12 17:37:31.556097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:37:31.556097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:37:31.556097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:37:31.556097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:37:31.556097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:37:31.556097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:37:31.556097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:37:31.556097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:31.556097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:37:31.556097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:37:31.558543 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4a4e837b171b4b4a9c2ad230cda53452", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:37:31.558543 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:31.558543 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:37:31.558543 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:31.558543 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:37:31.558543 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:37:31.558543 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:37:31.558543 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: 38a74ebdd59a491386aedcdbd312b363 Jul 12 17:37:31.558543 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:37:31.558543 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:37:31.558543 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 could not be found. Jul 12 17:37:31.558543 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': '88e50bdd-3716-421f-b6ca-832ee1f63c42'} Jul 12 17:37:31.560652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:37:31.560652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:31.560652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:37:31.560652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:37:31.560652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:37:31.560652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:37:31.560652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:37:31.560652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:37:31.560652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:37:31.560652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:37:31.560652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 could not be found. Jul 12 17:37:31.560652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:31.560652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:37:31.560652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:31.560652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:31.560652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:37:31.560652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:37:31.560652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:37:31.560652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:37:31.560652 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:37:31.563130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:37:31.563130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 17:37:31.563130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 17:37:31.563130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 17:37:31.563130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 17:37:31.563130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:37:31.563130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:37:31.563130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:37:31.563130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:37:31.563130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 could not be found. Jul 12 17:37:31.563130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:31.563130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:37:31.563130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:31.563130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:31.563130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:37:31.563130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:37:31.563130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:37:31.563130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:37:31.563130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 could not be found. Jul 12 17:37:31.563130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:31.567469 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cd4a55d3-0b0b-430d-8098-b4b0b2763c70 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Returning 404 to user: Instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:37:31.568415 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cd4a55d3-0b0b-430d-8098-b4b0b2763c70 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "DELETE /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 404 len: 111 microversion: 2.1 time: 0.055177 Jul 12 17:37:31.570127 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 599/1165] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:37:31 2022] DELETE /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:37:31.577719 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6dfab567-9b45-4c00-9751-55bf757ae2cd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:31.578914 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6dfab567-9b45-4c00-9751-55bf757ae2cd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 88e50bdd-3716-421f-b6ca-832ee1f63c42] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:31.585439 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6dfab567-9b45-4c00-9751-55bf757ae2cd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:31.585655 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6dfab567-9b45-4c00-9751-55bf757ae2cd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:31.586415 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6dfab567-9b45-4c00-9751-55bf757ae2cd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:31.586843 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6dfab567-9b45-4c00-9751-55bf757ae2cd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:31.603526 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-6dfab567-9b45-4c00-9751-55bf757ae2cd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] HTTP exception thrown: Instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 could not be found. Jul 12 17:37:31.606285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6dfab567-9b45-4c00-9751-55bf757ae2cd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Request method failure captured: Jul 12 17:37:31.606285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 HTTP/1.1 Jul 12 17:37:31.606285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:37:31.606285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:37:31.606285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:37:31.606285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:37:31.606285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:37:31.606285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:37:31.606285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:37:31.606285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:37:31.606285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza6s95YbmpHGEF6KuEgm1a_bLJ81FwTpSTIH7MTxyWuinNdKpad_B8P_UZWneUdxW68SGH3Srj8_vZq-CuSnlwKSv16guwMSxTDbOGQyNs0XrVu8KfhrnvEOXIz2ODhAC95eTPACdOrc6qWclLz7G-TtlizrY4gQ1jWkpckM6H1sbeY Jul 12 17:37:31.606285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:37:31.606285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:37:31.606285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:37:31.606285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:37:31.606285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:37:31.606285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:37:31.606285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:37:31.606285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:31.606285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:37:31.606285 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:37:31.608172 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4a4e837b171b4b4a9c2ad230cda53452", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:37:31.608172 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:31.608172 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:37:31.608172 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:31.608172 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:37:31.608172 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:37:31.608172 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:37:31.608172 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: 38a74ebdd59a491386aedcdbd312b363 Jul 12 17:37:31.608172 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:37:31.608172 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:37:31.608172 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 could not be found. Jul 12 17:37:31.608172 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': '88e50bdd-3716-421f-b6ca-832ee1f63c42'} Jul 12 17:37:31.609217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:37:31.609217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:31.609217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:37:31.609217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:37:31.609217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:37:31.609217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:37:31.609217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:37:31.609217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:37:31.609217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:37:31.609217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:37:31.609217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 could not be found. Jul 12 17:37:31.609217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:37:31.609217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:37:31.609217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:37:31.609217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:31.609217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:37:31.609217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:37:31.609217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:37:31.609217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:37:31.609217 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:37:31.610821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:37:31.610821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:37:31.610821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:37:31.610821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:37:31.610821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:37:31.610821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:37:31.610821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:37:31.610821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 could not be found. Jul 12 17:37:31.610821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:37:31.610821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:37:31.610821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:37:31.610821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:31.610821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:37:31.610821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:37:31.610821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:37:31.610821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:37:31.610821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 could not be found. Jul 12 17:37:31.610821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:37:31.613015 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6dfab567-9b45-4c00-9751-55bf757ae2cd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Returning 404 to user: Instance 88e50bdd-3716-421f-b6ca-832ee1f63c42 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:37:31.613997 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6dfab567-9b45-4c00-9751-55bf757ae2cd tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42" status: 404 len: 111 microversion: 2.1 time: 0.040687 Jul 12 17:37:31.617840 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 567/1166] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:31 2022] GET /compute/v2.1/servers/88e50bdd-3716-421f-b6ca-832ee1f63c42 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:37:32.789294 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c2b21564-8d55-4eb6-89ab-aa849e046b79 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:32.789980 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c2b21564-8d55-4eb6-89ab-aa849e046b79 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:32.797500 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c2b21564-8d55-4eb6-89ab-aa849e046b79 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:32.797971 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c2b21564-8d55-4eb6-89ab-aa849e046b79 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:32.798726 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c2b21564-8d55-4eb6-89ab-aa849e046b79 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:32.799159 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c2b21564-8d55-4eb6-89ab-aa849e046b79 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:32.812124 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-c2b21564-8d55-4eb6-89ab-aa849e046b79 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] HTTP exception thrown: Instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd could not be found. Jul 12 17:37:32.813938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c2b21564-8d55-4eb6-89ab-aa849e046b79 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Request method failure captured: Jul 12 17:37:32.813938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd HTTP/1.1 Jul 12 17:37:32.813938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:37:32.813938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:37:32.813938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:37:32.813938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:37:32.813938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:37:32.813938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:37:32.813938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:37:32.813938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:37:32.813938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza6s95YbmpHGEF6KuEgm1a_bLJ81FwTpSTIH7MTxyWuinNdKpad_B8P_UZWneUdxW68SGH3Srj8_vZq-CuSnlwKSv16guwMSxTDbOGQyNs0XrVu8KfhrnvEOXIz2ODhAC95eTPACdOrc6qWclLz7G-TtlizrY4gQ1jWkpckM6H1sbeY Jul 12 17:37:32.813938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:37:32.813938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:37:32.813938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:37:32.813938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:37:32.813938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:37:32.813938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:37:32.813938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:37:32.813938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:32.813938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:37:32.813938 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:37:32.815612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4a4e837b171b4b4a9c2ad230cda53452", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:37:32.815612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:32.815612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:37:32.815612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:32.815612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:37:32.815612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:37:32.815612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:37:32.815612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: 38a74ebdd59a491386aedcdbd312b363 Jul 12 17:37:32.815612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:37:32.815612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:37:32.815612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd could not be found. Jul 12 17:37:32.815612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': '58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd'} Jul 12 17:37:32.816584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:37:32.816584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:32.816584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:37:32.816584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:37:32.816584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:37:32.816584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:37:32.816584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:37:32.816584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:37:32.816584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:37:32.816584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:37:32.816584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd could not be found. Jul 12 17:37:32.816584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:32.816584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:37:32.816584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:32.816584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:32.816584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:37:32.816584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:37:32.816584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:37:32.816584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:37:32.816584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:37:32.818129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:37:32.818129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 17:37:32.818129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 17:37:32.818129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 17:37:32.818129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 17:37:32.818129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:37:32.818129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:37:32.818129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:37:32.818129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:37:32.818129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd could not be found. Jul 12 17:37:32.818129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:32.818129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:37:32.818129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:32.818129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:32.818129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:37:32.818129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:37:32.818129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:37:32.818129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:37:32.818129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd could not be found. Jul 12 17:37:32.818129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:32.819786 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c2b21564-8d55-4eb6-89ab-aa849e046b79 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Returning 404 to user: Instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:37:32.819786 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c2b21564-8d55-4eb6-89ab-aa849e046b79 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "DELETE /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd" status: 404 len: 111 microversion: 2.1 time: 0.029836 Jul 12 17:37:32.819786 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 600/1167] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:37:32 2022] DELETE /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:37:32.823611 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d1044eef-a4bc-4543-85fc-1c3d4b193326 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:32.824383 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d1044eef-a4bc-4543-85fc-1c3d4b193326 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:32.831660 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1044eef-a4bc-4543-85fc-1c3d4b193326 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:32.832108 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1044eef-a4bc-4543-85fc-1c3d4b193326 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:32.832875 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1044eef-a4bc-4543-85fc-1c3d4b193326 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:32.833312 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1044eef-a4bc-4543-85fc-1c3d4b193326 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:32.847843 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-d1044eef-a4bc-4543-85fc-1c3d4b193326 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] HTTP exception thrown: Instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd could not be found. Jul 12 17:37:32.850299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d1044eef-a4bc-4543-85fc-1c3d4b193326 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Request method failure captured: Jul 12 17:37:32.850299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd HTTP/1.1 Jul 12 17:37:32.850299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:37:32.850299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:37:32.850299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:37:32.850299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:37:32.850299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:37:32.850299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:37:32.850299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:37:32.850299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:37:32.850299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza6s95YbmpHGEF6KuEgm1a_bLJ81FwTpSTIH7MTxyWuinNdKpad_B8P_UZWneUdxW68SGH3Srj8_vZq-CuSnlwKSv16guwMSxTDbOGQyNs0XrVu8KfhrnvEOXIz2ODhAC95eTPACdOrc6qWclLz7G-TtlizrY4gQ1jWkpckM6H1sbeY Jul 12 17:37:32.850299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:37:32.850299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:37:32.850299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:37:32.850299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:37:32.850299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:37:32.850299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:37:32.850299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:37:32.850299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:32.850299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:37:32.850299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:37:32.852040 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4a4e837b171b4b4a9c2ad230cda53452", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:37:32.852040 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:32.852040 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:37:32.852040 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:32.852040 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:37:32.852040 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:37:32.852040 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:37:32.852040 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: 38a74ebdd59a491386aedcdbd312b363 Jul 12 17:37:32.852040 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:37:32.852040 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:37:32.852040 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd could not be found. Jul 12 17:37:32.852040 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': '58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd'} Jul 12 17:37:32.852957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:37:32.852957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:32.852957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:37:32.852957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:37:32.852957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:37:32.852957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:37:32.852957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:37:32.852957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:37:32.852957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:37:32.852957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:37:32.852957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd could not be found. Jul 12 17:37:32.852957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:37:32.852957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:37:32.852957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:37:32.852957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:32.852957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:37:32.852957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:37:32.852957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:37:32.852957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:37:32.852957 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:37:32.854500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:37:32.854500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:37:32.854500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:37:32.854500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:37:32.854500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:37:32.854500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:37:32.854500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:37:32.854500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd could not be found. Jul 12 17:37:32.854500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:37:32.854500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:37:32.854500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:37:32.854500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:32.854500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:37:32.854500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:37:32.854500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:37:32.854500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:37:32.854500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd could not be found. Jul 12 17:37:32.854500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:37:32.855616 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d1044eef-a4bc-4543-85fc-1c3d4b193326 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Returning 404 to user: Instance 58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:37:32.855616 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d1044eef-a4bc-4543-85fc-1c3d4b193326 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd" status: 404 len: 111 microversion: 2.1 time: 0.032354 Jul 12 17:37:32.855616 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 568/1168] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:32 2022] GET /compute/v2.1/servers/58844ef5-5337-4d5a-9c3f-ee86e1e3f1bd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:37:32.861666 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0330ca94-8064-4e2d-8dad-65bbc2c13f6b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:32.862197 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0330ca94-8064-4e2d-8dad-65bbc2c13f6b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:32.868195 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0330ca94-8064-4e2d-8dad-65bbc2c13f6b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:32.868648 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0330ca94-8064-4e2d-8dad-65bbc2c13f6b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:32.869415 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0330ca94-8064-4e2d-8dad-65bbc2c13f6b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:32.869897 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0330ca94-8064-4e2d-8dad-65bbc2c13f6b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:32.883242 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-0330ca94-8064-4e2d-8dad-65bbc2c13f6b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] HTTP exception thrown: Instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 could not be found. Jul 12 17:37:32.884792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0330ca94-8064-4e2d-8dad-65bbc2c13f6b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Request method failure captured: Jul 12 17:37:32.884792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 HTTP/1.1 Jul 12 17:37:32.884792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:37:32.884792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:37:32.884792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:37:32.884792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:37:32.884792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:37:32.884792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:37:32.884792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:37:32.884792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:37:32.884792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza6s95YbmpHGEF6KuEgm1a_bLJ81FwTpSTIH7MTxyWuinNdKpad_B8P_UZWneUdxW68SGH3Srj8_vZq-CuSnlwKSv16guwMSxTDbOGQyNs0XrVu8KfhrnvEOXIz2ODhAC95eTPACdOrc6qWclLz7G-TtlizrY4gQ1jWkpckM6H1sbeY Jul 12 17:37:32.884792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:37:32.884792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:37:32.884792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:37:32.884792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:37:32.884792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:37:32.884792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:37:32.884792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:37:32.884792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:32.884792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:37:32.884792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:37:32.886527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4a4e837b171b4b4a9c2ad230cda53452", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:37:32.886527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:32.886527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:37:32.886527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:32.886527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:37:32.886527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:37:32.886527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:37:32.886527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: 38a74ebdd59a491386aedcdbd312b363 Jul 12 17:37:32.886527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:37:32.886527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:37:32.886527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 could not be found. Jul 12 17:37:32.886527 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': '34d0b582-fd90-42a8-a0cf-9acd222b3d26'} Jul 12 17:37:32.887397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:37:32.887397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:32.887397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:37:32.887397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:37:32.887397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:37:32.887397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:37:32.887397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:37:32.887397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:37:32.887397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:37:32.887397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:37:32.887397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 could not be found. Jul 12 17:37:32.887397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:32.887397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:37:32.887397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:32.887397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:32.887397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:37:32.887397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:37:32.887397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:37:32.887397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:37:32.887397 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:37:32.888906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:37:32.888906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 17:37:32.888906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 17:37:32.888906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 17:37:32.888906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 17:37:32.888906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:37:32.888906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:37:32.888906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:37:32.888906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:37:32.888906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 could not be found. Jul 12 17:37:32.888906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:32.888906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:37:32.888906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:32.888906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:32.888906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:37:32.888906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:37:32.888906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:37:32.888906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:37:32.888906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 could not be found. Jul 12 17:37:32.888906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:32.890937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0330ca94-8064-4e2d-8dad-65bbc2c13f6b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Returning 404 to user: Instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:37:32.890937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0330ca94-8064-4e2d-8dad-65bbc2c13f6b tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "DELETE /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 404 len: 111 microversion: 2.1 time: 0.029007 Jul 12 17:37:32.890937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 601/1169] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:37:32 2022] DELETE /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:37:32.895117 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b6ffdb42-947a-4578-a0c3-df39a12171a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:32.895737 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b6ffdb42-947a-4578-a0c3-df39a12171a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 34d0b582-fd90-42a8-a0cf-9acd222b3d26] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:32.901792 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b6ffdb42-947a-4578-a0c3-df39a12171a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:32.902242 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b6ffdb42-947a-4578-a0c3-df39a12171a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:32.903005 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b6ffdb42-947a-4578-a0c3-df39a12171a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:32.903443 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b6ffdb42-947a-4578-a0c3-df39a12171a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:32.917094 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-b6ffdb42-947a-4578-a0c3-df39a12171a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] HTTP exception thrown: Instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 could not be found. Jul 12 17:37:32.918615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b6ffdb42-947a-4578-a0c3-df39a12171a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Request method failure captured: Jul 12 17:37:32.918615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 HTTP/1.1 Jul 12 17:37:32.918615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:37:32.918615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:37:32.918615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:37:32.918615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:37:32.918615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:37:32.918615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:37:32.918615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:37:32.918615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:37:32.918615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza6s95YbmpHGEF6KuEgm1a_bLJ81FwTpSTIH7MTxyWuinNdKpad_B8P_UZWneUdxW68SGH3Srj8_vZq-CuSnlwKSv16guwMSxTDbOGQyNs0XrVu8KfhrnvEOXIz2ODhAC95eTPACdOrc6qWclLz7G-TtlizrY4gQ1jWkpckM6H1sbeY Jul 12 17:37:32.918615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:37:32.918615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:37:32.918615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:37:32.918615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:37:32.918615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:37:32.918615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:37:32.918615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:37:32.918615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:32.918615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:37:32.918615 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:37:32.920268 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4a4e837b171b4b4a9c2ad230cda53452", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:37:32.920268 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:32.920268 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:37:32.920268 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:32.920268 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:37:32.920268 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:37:32.920268 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:37:32.920268 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: 38a74ebdd59a491386aedcdbd312b363 Jul 12 17:37:32.920268 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:37:32.920268 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:37:32.920268 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 could not be found. Jul 12 17:37:32.920268 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': '34d0b582-fd90-42a8-a0cf-9acd222b3d26'} Jul 12 17:37:32.921198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:37:32.921198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:32.921198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:37:32.921198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:37:32.921198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:37:32.921198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:37:32.921198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:37:32.921198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:37:32.921198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:37:32.921198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:37:32.921198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 could not be found. Jul 12 17:37:32.921198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:37:32.921198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:37:32.921198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:37:32.921198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:32.921198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:37:32.921198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:37:32.921198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:37:32.921198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:37:32.921198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:37:32.922720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:37:32.922720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:37:32.922720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:37:32.922720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:37:32.922720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:37:32.922720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:37:32.922720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:37:32.922720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 could not be found. Jul 12 17:37:32.922720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:37:32.922720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:37:32.922720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:37:32.922720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:32.922720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:37:32.922720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:37:32.922720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:37:32.922720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:37:32.922720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 could not be found. Jul 12 17:37:32.922720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:37:32.924140 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b6ffdb42-947a-4578-a0c3-df39a12171a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Returning 404 to user: Instance 34d0b582-fd90-42a8-a0cf-9acd222b3d26 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:37:32.924140 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b6ffdb42-947a-4578-a0c3-df39a12171a8 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26" status: 404 len: 111 microversion: 2.1 time: 0.028702 Jul 12 17:37:32.924140 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 569/1170] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:32 2022] GET /compute/v2.1/servers/34d0b582-fd90-42a8-a0cf-9acd222b3d26 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:37:34.051560 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4e5b18c9-e0e3-4d71-b3d6-608669d3cf9f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:34.052051 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4e5b18c9-e0e3-4d71-b3d6-608669d3cf9f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:34.058384 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4e5b18c9-e0e3-4d71-b3d6-608669d3cf9f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:34.058831 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4e5b18c9-e0e3-4d71-b3d6-608669d3cf9f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:34.059578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4e5b18c9-e0e3-4d71-b3d6-608669d3cf9f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:34.060009 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4e5b18c9-e0e3-4d71-b3d6-608669d3cf9f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:34.074551 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-4e5b18c9-e0e3-4d71-b3d6-608669d3cf9f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] HTTP exception thrown: Instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 could not be found. Jul 12 17:37:34.076065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4e5b18c9-e0e3-4d71-b3d6-608669d3cf9f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Request method failure captured: Jul 12 17:37:34.076065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 HTTP/1.1 Jul 12 17:37:34.076065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:37:34.076065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:37:34.076065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:37:34.076065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:37:34.076065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:37:34.076065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:37:34.076065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:37:34.076065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:37:34.076065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza6s95YbmpHGEF6KuEgm1a_bLJ81FwTpSTIH7MTxyWuinNdKpad_B8P_UZWneUdxW68SGH3Srj8_vZq-CuSnlwKSv16guwMSxTDbOGQyNs0XrVu8KfhrnvEOXIz2ODhAC95eTPACdOrc6qWclLz7G-TtlizrY4gQ1jWkpckM6H1sbeY Jul 12 17:37:34.076065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:37:34.076065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:37:34.076065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:37:34.076065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:37:34.076065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:37:34.076065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:37:34.076065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:37:34.076065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:34.076065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:37:34.076065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:37:34.077751 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4a4e837b171b4b4a9c2ad230cda53452", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:37:34.077751 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:34.077751 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:37:34.077751 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:34.077751 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:37:34.077751 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:37:34.077751 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:37:34.077751 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: 38a74ebdd59a491386aedcdbd312b363 Jul 12 17:37:34.077751 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:37:34.077751 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:37:34.077751 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 could not be found. Jul 12 17:37:34.077751 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': '58fa8d33-4b3c-45f2-8d46-38f4f5932cf2'} Jul 12 17:37:34.078738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:37:34.078738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:34.078738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:37:34.078738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:37:34.078738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:37:34.078738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:37:34.078738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:37:34.078738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:37:34.078738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:37:34.078738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:37:34.078738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 could not be found. Jul 12 17:37:34.078738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:34.078738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:37:34.078738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:34.078738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:34.078738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:37:34.078738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:37:34.078738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:37:34.078738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:37:34.078738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:37:34.080440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:37:34.080440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 17:37:34.080440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 17:37:34.080440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 17:37:34.080440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 17:37:34.080440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:37:34.080440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:37:34.080440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:37:34.080440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:37:34.080440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 could not be found. Jul 12 17:37:34.080440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:34.080440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:37:34.080440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:34.080440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:34.080440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:37:34.080440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:37:34.080440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:37:34.080440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:37:34.080440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 could not be found. Jul 12 17:37:34.080440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:37:34.082288 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4e5b18c9-e0e3-4d71-b3d6-608669d3cf9f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Returning 404 to user: Instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:37:34.082288 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4e5b18c9-e0e3-4d71-b3d6-608669d3cf9f tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "DELETE /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 404 len: 111 microversion: 2.1 time: 0.029671 Jul 12 17:37:34.082288 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 602/1171] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:37:34 2022] DELETE /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:37:34.085824 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a2e59209-6eb8-4684-a7b7-852aa5c6ce07 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:37:34.086478 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a2e59209-6eb8-4684-a7b7-852aa5c6ce07 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] [instance: 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:37:34.088562 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:37:34.094506 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a2e59209-6eb8-4684-a7b7-852aa5c6ce07 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:34.094954 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a2e59209-6eb8-4684-a7b7-852aa5c6ce07 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:34.095752 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a2e59209-6eb8-4684-a7b7-852aa5c6ce07 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:37:34.096188 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a2e59209-6eb8-4684-a7b7-852aa5c6ce07 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:37:34.110747 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-a2e59209-6eb8-4684-a7b7-852aa5c6ce07 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] HTTP exception thrown: Instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 could not be found. Jul 12 17:37:34.112245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a2e59209-6eb8-4684-a7b7-852aa5c6ce07 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Request method failure captured: Jul 12 17:37:34.112245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 HTTP/1.1 Jul 12 17:37:34.112245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:37:34.112245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:37:34.112245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:37:34.112245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:37:34.112245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:37:34.112245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:37:34.112245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:37:34.112245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:37:34.112245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza6s95YbmpHGEF6KuEgm1a_bLJ81FwTpSTIH7MTxyWuinNdKpad_B8P_UZWneUdxW68SGH3Srj8_vZq-CuSnlwKSv16guwMSxTDbOGQyNs0XrVu8KfhrnvEOXIz2ODhAC95eTPACdOrc6qWclLz7G-TtlizrY4gQ1jWkpckM6H1sbeY Jul 12 17:37:34.112245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:37:34.112245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:37:34.112245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:37:34.112245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:37:34.112245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:37:34.112245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:37:34.112245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:37:34.112245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:34.112245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:37:34.112245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:37:34.113925 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a4e837b171b4b4a9c2ad230cda53452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4a4e837b171b4b4a9c2ad230cda53452", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:37:34.113925 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:34.113925 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 4a4e837b171b4b4a9c2ad230cda53452 Jul 12 17:37:34.113925 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22600293 Jul 12 17:37:34.113925 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:37:34.113925 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:37:34.113925 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:37:34.113925 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: 38a74ebdd59a491386aedcdbd312b363 Jul 12 17:37:34.113925 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeNegativeTest-22600293-project Jul 12 17:37:34.113925 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:37:34.113925 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 could not be found. Jul 12 17:37:34.113925 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': '58fa8d33-4b3c-45f2-8d46-38f4f5932cf2'} Jul 12 17:37:34.115150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:37:34.115150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:34.115150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:37:34.115150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:37:34.115150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:37:34.115150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:37:34.115150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:37:34.115150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:37:34.115150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:37:34.115150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:37:34.115150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 could not be found. Jul 12 17:37:34.115150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:37:34.115150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:37:34.115150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:37:34.115150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:34.115150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:37:34.115150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:37:34.115150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:37:34.115150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:37:34.115150 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:37:34.116714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:37:34.116714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:37:34.116714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:37:34.116714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:37:34.116714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:37:34.116714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:37:34.116714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:37:34.116714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 could not be found. Jul 12 17:37:34.116714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:37:34.116714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:37:34.116714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:37:34.116714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:37:34.116714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:37:34.116714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:37:34.116714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:37:34.116714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:37:34.116714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 could not be found. Jul 12 17:37:34.116714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:37:34.118319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a2e59209-6eb8-4684-a7b7-852aa5c6ce07 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] Returning 404 to user: Instance 58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:37:34.118319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a2e59209-6eb8-4684-a7b7-852aa5c6ce07 tempest-AttachVolumeNegativeTest-22600293 tempest-AttachVolumeNegativeTest-22600293-project] 10.222.0.62 "GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2" status: 404 len: 111 microversion: 2.1 time: 0.031739 Jul 12 17:37:34.118319 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 570/1172] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:37:34 2022] GET /compute/v2.1/servers/58fa8d33-4b3c-45f2-8d46-38f4f5932cf2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:38:20.522132 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ae40c955-8178-4790-919d-a5343e5a13fe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:20.523066 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ae40c955-8178-4790-919d-a5343e5a13fe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:20.525600 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:20.526260 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=13 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:20.532826 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ae40c955-8178-4790-919d-a5343e5a13fe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:20.533272 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ae40c955-8178-4790-919d-a5343e5a13fe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:20.534066 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ae40c955-8178-4790-919d-a5343e5a13fe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:20.534522 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ae40c955-8178-4790-919d-a5343e5a13fe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:20.565199 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ae40c955-8178-4790-919d-a5343e5a13fe tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047047 Jul 12 17:38:20.565850 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 603/1173] 10.222.0.62 () {60 vars in 1342 bytes} [Tue Jul 12 17:38:20 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:38:20.624687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a686ee89-50d7-4bb9-a63c-43bf6f098fdf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:20.625280 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a686ee89-50d7-4bb9-a63c-43bf6f098fdf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:20.627543 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=93 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:20.628168 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:20.633840 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a686ee89-50d7-4bb9-a63c-43bf6f098fdf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:20.634283 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a686ee89-50d7-4bb9-a63c-43bf6f098fdf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:20.635051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a686ee89-50d7-4bb9-a63c-43bf6f098fdf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:20.635483 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a686ee89-50d7-4bb9-a63c-43bf6f098fdf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:20.661542 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a686ee89-50d7-4bb9-a63c-43bf6f098fdf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Going to try to terminate instance {{(pid=117939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:38:20.737655 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a686ee89-50d7-4bb9-a63c-43bf6f098fdf tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "DELETE /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 204 len: 0 microversion: 2.20 time: 0.117271 Jul 12 17:38:20.738237 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 571/1174] 10.222.0.62 () {60 vars in 1279 bytes} [Tue Jul 12 17:38:20 2022] DELETE /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 17:38:20.746792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-5b42fdfb-a9ac-46c9-b3aa-a1a566a7d00e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:20.747405 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-5b42fdfb-a9ac-46c9-b3aa-a1a566a7d00e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:20.753720 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5b42fdfb-a9ac-46c9-b3aa-a1a566a7d00e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:20.754189 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5b42fdfb-a9ac-46c9-b3aa-a1a566a7d00e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:20.755004 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5b42fdfb-a9ac-46c9-b3aa-a1a566a7d00e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:20.755439 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-5b42fdfb-a9ac-46c9-b3aa-a1a566a7d00e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:20.895880 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5b42fdfb-a9ac-46c9-b3aa-a1a566a7d00e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:20.903854 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5b42fdfb-a9ac-46c9-b3aa-a1a566a7d00e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:20.905496 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-5b42fdfb-a9ac-46c9-b3aa-a1a566a7d00e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:20.907194 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-5b42fdfb-a9ac-46c9-b3aa-a1a566a7d00e tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1723 microversion: 2.20 time: 0.164483 Jul 12 17:38:20.910244 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 604/1175] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:38:20 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:38:21.926682 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-f6574f4c-43df-40a9-97cf-9bf85c4a81f9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:21.927391 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-f6574f4c-43df-40a9-97cf-9bf85c4a81f9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:21.934408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f6574f4c-43df-40a9-97cf-9bf85c4a81f9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:21.934862 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f6574f4c-43df-40a9-97cf-9bf85c4a81f9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:21.935643 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f6574f4c-43df-40a9-97cf-9bf85c4a81f9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:21.936083 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-f6574f4c-43df-40a9-97cf-9bf85c4a81f9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:22.066967 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f6574f4c-43df-40a9-97cf-9bf85c4a81f9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:22.075144 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f6574f4c-43df-40a9-97cf-9bf85c4a81f9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:22.076680 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-f6574f4c-43df-40a9-97cf-9bf85c4a81f9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:22.077895 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-f6574f4c-43df-40a9-97cf-9bf85c4a81f9 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1723 microversion: 2.20 time: 0.156247 Jul 12 17:38:22.078442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 572/1176] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:38:21 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:38:23.096734 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-669f361c-8c24-45b0-925b-eb2bb4ad3147 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:23.097429 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-669f361c-8c24-45b0-925b-eb2bb4ad3147 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:23.103677 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-669f361c-8c24-45b0-925b-eb2bb4ad3147 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:23.104192 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-669f361c-8c24-45b0-925b-eb2bb4ad3147 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:23.105023 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-669f361c-8c24-45b0-925b-eb2bb4ad3147 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:23.105457 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-669f361c-8c24-45b0-925b-eb2bb4ad3147 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:23.308947 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-669f361c-8c24-45b0-925b-eb2bb4ad3147 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:23.317463 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-669f361c-8c24-45b0-925b-eb2bb4ad3147 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:23.319069 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-669f361c-8c24-45b0-925b-eb2bb4ad3147 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:23.320226 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-669f361c-8c24-45b0-925b-eb2bb4ad3147 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1723 microversion: 2.20 time: 0.227481 Jul 12 17:38:23.320773 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 605/1177] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:38:23 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:38:23.836651 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-3bb61063-d283-4c75-8ced-5d7b8a1422ad req-5b83b233-10f8-4130-a706-380102260c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeedc087-222c-4452-bf37-2f152ce787a6", "name": "network-vif-deleted", "tag": "c8a34f14-81f6-401c-83f7-ce051f443de8"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:38:23.848559 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-3bb61063-d283-4c75-8ced-5d7b8a1422ad req-5b83b233-10f8-4130-a706-380102260c11 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:23.849115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-3bb61063-d283-4c75-8ced-5d7b8a1422ad req-5b83b233-10f8-4130-a706-380102260c11 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:23.861261 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-3bb61063-d283-4c75-8ced-5d7b8a1422ad req-5b83b233-10f8-4130-a706-380102260c11 service nova] Creating event network-vif-deleted:c8a34f14-81f6-401c-83f7-ce051f443de8 for instance aeedc087-222c-4452-bf37-2f152ce787a6 on hv-cinder-84932 Jul 12 17:38:23.867157 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-3bb61063-d283-4c75-8ced-5d7b8a1422ad req-5b83b233-10f8-4130-a706-380102260c11 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039172 Jul 12 17:38:23.867858 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 573/1178] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:38:24.339371 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a40d2eb5-54e5-4c7b-81a9-868a00ace2d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:24.340009 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a40d2eb5-54e5-4c7b-81a9-868a00ace2d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:24.348247 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a40d2eb5-54e5-4c7b-81a9-868a00ace2d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:24.348703 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a40d2eb5-54e5-4c7b-81a9-868a00ace2d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:24.349475 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a40d2eb5-54e5-4c7b-81a9-868a00ace2d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:24.350126 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a40d2eb5-54e5-4c7b-81a9-868a00ace2d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:24.382680 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a40d2eb5-54e5-4c7b-81a9-868a00ace2d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:24.383223 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a40d2eb5-54e5-4c7b-81a9-868a00ace2d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:24.383747 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-a40d2eb5-54e5-4c7b-81a9-868a00ace2d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lazy-loading 'fault' on Instance uuid aeedc087-222c-4452-bf37-2f152ce787a6 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:38:24.427284 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a40d2eb5-54e5-4c7b-81a9-868a00ace2d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:24.435336 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a40d2eb5-54e5-4c7b-81a9-868a00ace2d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:24.437144 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-a40d2eb5-54e5-4c7b-81a9-868a00ace2d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '673bd0c57ab842f4925c770c8959354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47989251b16474f830f5a46efe33812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:24.438952 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a40d2eb5-54e5-4c7b-81a9-868a00ace2d7 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 200 len: 1370 microversion: 2.20 time: 0.102874 Jul 12 17:38:24.439461 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 606/1179] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:38:24 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 1370 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 17:38:25.458488 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-33886ba6-984d-42c4-aca9-164e977b0869 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:25.459182 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-33886ba6-984d-42c4-aca9-164e977b0869 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:25.465283 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-33886ba6-984d-42c4-aca9-164e977b0869 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:25.465750 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-33886ba6-984d-42c4-aca9-164e977b0869 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:25.466510 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-33886ba6-984d-42c4-aca9-164e977b0869 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:25.466974 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-33886ba6-984d-42c4-aca9-164e977b0869 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:25.480355 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-33886ba6-984d-42c4-aca9-164e977b0869 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] HTTP exception thrown: Instance aeedc087-222c-4452-bf37-2f152ce787a6 could not be found. Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-33886ba6-984d-42c4-aca9-164e977b0869 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Request method failure captured: Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 HTTP/1.1 Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza8YWCq6igHxkDwkgh4oavPD182z4-F2IEhGSz-TaeAD8ZZzMxigLg6gYeCMYCTd914ppxmhU5Oxa7RORu-eETY3-krDgfFrxFFLeG7uePmey9a-HRjBVjOM1QxDuVIIBWmAbEq019sqt749QhT6o5MV0jMm5wUT2Dao5f_KVZ9NAII Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: a47989251b16474f830f5a46efe33812 Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-110492675 Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:38:25.481984 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:38:25.483733 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a47989251b16474f830f5a46efe33812"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a47989251b16474f830f5a46efe33812"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a47989251b16474f830f5a46efe33812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a47989251b16474f830f5a46efe33812", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:38:25.483733 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeShelveTestJSON-110492675 Jul 12 17:38:25.483733 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: a47989251b16474f830f5a46efe33812 Jul 12 17:38:25.483733 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-110492675 Jul 12 17:38:25.483733 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeShelveTestJSON-110492675-project Jul 12 17:38:25.483733 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:38:25.483733 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:38:25.483733 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: 673bd0c57ab842f4925c770c8959354d Jul 12 17:38:25.483733 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeShelveTestJSON-110492675-project Jul 12 17:38:25.483733 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:38:25.483733 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance aeedc087-222c-4452-bf37-2f152ce787a6 could not be found. Jul 12 17:38:25.483733 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': 'aeedc087-222c-4452-bf37-2f152ce787a6'} Jul 12 17:38:25.484688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:38:25.484688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:38:25.484688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:38:25.484688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:38:25.484688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:38:25.484688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:38:25.484688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:38:25.484688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:38:25.484688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:38:25.484688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:38:25.484688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeedc087-222c-4452-bf37-2f152ce787a6 could not be found. Jul 12 17:38:25.484688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:38:25.484688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:38:25.484688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:38:25.484688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:38:25.484688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:38:25.484688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:38:25.484688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:38:25.484688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:38:25.484688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:38:25.486353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:38:25.486353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:38:25.486353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:38:25.486353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:38:25.486353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:38:25.486353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:38:25.486353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:38:25.486353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeedc087-222c-4452-bf37-2f152ce787a6 could not be found. Jul 12 17:38:25.486353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:38:25.486353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:38:25.486353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:38:25.486353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:38:25.486353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:38:25.486353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:38:25.486353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:38:25.486353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:38:25.486353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeedc087-222c-4452-bf37-2f152ce787a6 could not be found. Jul 12 17:38:25.486353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:38:25.487904 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-33886ba6-984d-42c4-aca9-164e977b0869 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Returning 404 to user: Instance aeedc087-222c-4452-bf37-2f152ce787a6 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:38:25.487904 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-33886ba6-984d-42c4-aca9-164e977b0869 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 404 len: 111 microversion: 2.20 time: 0.030067 Jul 12 17:38:25.487904 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 574/1180] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:38:25 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 17:38:25.491989 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-833be16d-4851-4828-8bd9-c75fe3bea3f4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '.version_select at 0x7f872e1b28b0>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:25.508617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-833be16d-4851-4828-8bd9-c75fe3bea3f4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-625185159" status: 204 len: 0 microversion: 2.20 time: 0.020451 Jul 12 17:38:25.509159 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 607/1181] 10.222.0.62 () {60 vars in 1258 bytes} [Tue Jul 12 17:38:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-625185159 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 12 17:38:27.242538 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d233f026-26b7-41b2-be83-4a31cbc292d4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:27.243069 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d233f026-26b7-41b2-be83-4a31cbc292d4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:27.249446 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d233f026-26b7-41b2-be83-4a31cbc292d4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:27.249927 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d233f026-26b7-41b2-be83-4a31cbc292d4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:27.250707 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d233f026-26b7-41b2-be83-4a31cbc292d4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:27.251146 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d233f026-26b7-41b2-be83-4a31cbc292d4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:27.266000 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-d233f026-26b7-41b2-be83-4a31cbc292d4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] HTTP exception thrown: Instance aeedc087-222c-4452-bf37-2f152ce787a6 could not be found. Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d233f026-26b7-41b2-be83-4a31cbc292d4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Request method failure captured: Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: DELETE /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 HTTP/1.1 Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza8YWCq6igHxkDwkgh4oavPD182z4-F2IEhGSz-TaeAD8ZZzMxigLg6gYeCMYCTd914ppxmhU5Oxa7RORu-eETY3-krDgfFrxFFLeG7uePmey9a-HRjBVjOM1QxDuVIIBWmAbEq019sqt749QhT6o5MV0jMm5wUT2Dao5f_KVZ9NAII Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: a47989251b16474f830f5a46efe33812 Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-110492675 Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:38:27.268027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:38:27.269584 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a47989251b16474f830f5a46efe33812"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a47989251b16474f830f5a46efe33812"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a47989251b16474f830f5a46efe33812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a47989251b16474f830f5a46efe33812", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:38:27.269584 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeShelveTestJSON-110492675 Jul 12 17:38:27.269584 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: a47989251b16474f830f5a46efe33812 Jul 12 17:38:27.269584 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-110492675 Jul 12 17:38:27.269584 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeShelveTestJSON-110492675-project Jul 12 17:38:27.269584 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:38:27.269584 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:38:27.269584 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: 673bd0c57ab842f4925c770c8959354d Jul 12 17:38:27.269584 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeShelveTestJSON-110492675-project Jul 12 17:38:27.269584 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:38:27.269584 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance aeedc087-222c-4452-bf37-2f152ce787a6 could not be found. Jul 12 17:38:27.269584 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': 'aeedc087-222c-4452-bf37-2f152ce787a6'} Jul 12 17:38:27.270501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:38:27.270501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:38:27.270501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:38:27.270501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:38:27.270501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:38:27.270501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:38:27.270501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:38:27.270501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:38:27.270501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:38:27.270501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:38:27.270501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeedc087-222c-4452-bf37-2f152ce787a6 could not be found. Jul 12 17:38:27.270501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:38:27.270501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:38:27.270501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:38:27.270501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:38:27.270501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:38:27.270501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:38:27.270501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:38:27.270501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:38:27.270501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:38:27.272095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:38:27.272095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 17:38:27.272095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 17:38:27.272095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 17:38:27.272095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 17:38:27.272095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:38:27.272095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:38:27.272095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:38:27.272095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:38:27.272095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeedc087-222c-4452-bf37-2f152ce787a6 could not be found. Jul 12 17:38:27.272095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:38:27.272095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:38:27.272095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:38:27.272095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:38:27.272095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:38:27.272095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:38:27.272095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:38:27.272095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:38:27.272095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeedc087-222c-4452-bf37-2f152ce787a6 could not be found. Jul 12 17:38:27.272095 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:38:27.274032 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d233f026-26b7-41b2-be83-4a31cbc292d4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Returning 404 to user: Instance aeedc087-222c-4452-bf37-2f152ce787a6 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:38:27.274032 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d233f026-26b7-41b2-be83-4a31cbc292d4 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "DELETE /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 404 len: 111 microversion: 2.20 time: 0.030708 Jul 12 17:38:27.274032 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 575/1182] 10.222.0.62 () {60 vars in 1279 bytes} [Tue Jul 12 17:38:27 2022] DELETE /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 17:38:27.278331 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b5ae3a47-fa8b-455c-af89-da3d1e6438ea tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:27.278977 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-b5ae3a47-fa8b-455c-af89-da3d1e6438ea tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: aeedc087-222c-4452-bf37-2f152ce787a6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:27.286140 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b5ae3a47-fa8b-455c-af89-da3d1e6438ea tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:27.286590 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b5ae3a47-fa8b-455c-af89-da3d1e6438ea tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:27.287347 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b5ae3a47-fa8b-455c-af89-da3d1e6438ea tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:27.287782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-b5ae3a47-fa8b-455c-af89-da3d1e6438ea tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:27.300499 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-b5ae3a47-fa8b-455c-af89-da3d1e6438ea tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] HTTP exception thrown: Instance aeedc087-222c-4452-bf37-2f152ce787a6 could not be found. Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b5ae3a47-fa8b-455c-af89-da3d1e6438ea tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Request method failure captured: Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 HTTP/1.1 Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza8YWCq6igHxkDwkgh4oavPD182z4-F2IEhGSz-TaeAD8ZZzMxigLg6gYeCMYCTd914ppxmhU5Oxa7RORu-eETY3-krDgfFrxFFLeG7uePmey9a-HRjBVjOM1QxDuVIIBWmAbEq019sqt749QhT6o5MV0jMm5wUT2Dao5f_KVZ9NAII Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: a47989251b16474f830f5a46efe33812 Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-110492675 Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:38:27.302048 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:38:27.304158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a47989251b16474f830f5a46efe33812"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a47989251b16474f830f5a46efe33812"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a47989251b16474f830f5a46efe33812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a47989251b16474f830f5a46efe33812", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:38:27.304158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeShelveTestJSON-110492675 Jul 12 17:38:27.304158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: a47989251b16474f830f5a46efe33812 Jul 12 17:38:27.304158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-110492675 Jul 12 17:38:27.304158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeShelveTestJSON-110492675-project Jul 12 17:38:27.304158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:38:27.304158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:38:27.304158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: 673bd0c57ab842f4925c770c8959354d Jul 12 17:38:27.304158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeShelveTestJSON-110492675-project Jul 12 17:38:27.304158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:38:27.304158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Instance aeedc087-222c-4452-bf37-2f152ce787a6 could not be found. Jul 12 17:38:27.304158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': 'aeedc087-222c-4452-bf37-2f152ce787a6'} Jul 12 17:38:27.305296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:38:27.305296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:38:27.305296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:38:27.305296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:38:27.305296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:38:27.305296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:38:27.305296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:38:27.305296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:38:27.305296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:38:27.305296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:38:27.305296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeedc087-222c-4452-bf37-2f152ce787a6 could not be found. Jul 12 17:38:27.305296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:38:27.305296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:38:27.305296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:38:27.305296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:38:27.305296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:38:27.305296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:38:27.305296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:38:27.305296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:38:27.305296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:38:27.307201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:38:27.307201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:38:27.307201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:38:27.307201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:38:27.307201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:38:27.307201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:38:27.307201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:38:27.307201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeedc087-222c-4452-bf37-2f152ce787a6 could not be found. Jul 12 17:38:27.307201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:38:27.307201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:38:27.307201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:38:27.307201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:38:27.307201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:38:27.307201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:38:27.307201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:38:27.307201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:38:27.307201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeedc087-222c-4452-bf37-2f152ce787a6 could not be found. Jul 12 17:38:27.307201 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:38:27.308529 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-b5ae3a47-fa8b-455c-af89-da3d1e6438ea tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Returning 404 to user: Instance aeedc087-222c-4452-bf37-2f152ce787a6 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:38:27.308529 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-b5ae3a47-fa8b-455c-af89-da3d1e6438ea tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6" status: 404 len: 111 microversion: 2.20 time: 0.029528 Jul 12 17:38:27.308529 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 608/1183] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:38:27 2022] GET /compute/v2.1/servers/aeedc087-222c-4452-bf37-2f152ce787a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 17:38:28.435163 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2c388c71-29d6-47f7-a492-fef2e4617b60 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:28.435661 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2c388c71-29d6-47f7-a492-fef2e4617b60 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:28.442305 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c388c71-29d6-47f7-a492-fef2e4617b60 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:28.442757 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c388c71-29d6-47f7-a492-fef2e4617b60 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:28.443519 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c388c71-29d6-47f7-a492-fef2e4617b60 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:28.443953 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2c388c71-29d6-47f7-a492-fef2e4617b60 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:28.456960 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-2c388c71-29d6-47f7-a492-fef2e4617b60 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] HTTP exception thrown: Instance 48b5e50f-5079-438b-ac33-67623b4428f5 could not be found. Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2c388c71-29d6-47f7-a492-fef2e4617b60 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Request method failure captured: Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: DELETE /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 HTTP/1.1 Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza8YWCq6igHxkDwkgh4oavPD182z4-F2IEhGSz-TaeAD8ZZzMxigLg6gYeCMYCTd914ppxmhU5Oxa7RORu-eETY3-krDgfFrxFFLeG7uePmey9a-HRjBVjOM1QxDuVIIBWmAbEq019sqt749QhT6o5MV0jMm5wUT2Dao5f_KVZ9NAII Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: a47989251b16474f830f5a46efe33812 Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-110492675 Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:38:28.458544 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:38:28.460287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a47989251b16474f830f5a46efe33812"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a47989251b16474f830f5a46efe33812"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a47989251b16474f830f5a46efe33812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a47989251b16474f830f5a46efe33812", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:38:28.460287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeShelveTestJSON-110492675 Jul 12 17:38:28.460287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: a47989251b16474f830f5a46efe33812 Jul 12 17:38:28.460287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-110492675 Jul 12 17:38:28.460287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeShelveTestJSON-110492675-project Jul 12 17:38:28.460287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:38:28.460287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:38:28.460287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: 673bd0c57ab842f4925c770c8959354d Jul 12 17:38:28.460287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeShelveTestJSON-110492675-project Jul 12 17:38:28.460287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:38:28.460287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance 48b5e50f-5079-438b-ac33-67623b4428f5 could not be found. Jul 12 17:38:28.460287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': '48b5e50f-5079-438b-ac33-67623b4428f5'} Jul 12 17:38:28.461417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:38:28.461417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:38:28.461417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:38:28.461417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:38:28.461417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:38:28.461417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:38:28.461417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:38:28.461417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:38:28.461417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:38:28.461417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:38:28.461417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48b5e50f-5079-438b-ac33-67623b4428f5 could not be found. Jul 12 17:38:28.461417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:38:28.461417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:38:28.461417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:38:28.461417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:38:28.461417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:38:28.461417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:38:28.461417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:38:28.461417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:38:28.461417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:38:28.463115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:38:28.463115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 17:38:28.463115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 17:38:28.463115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 17:38:28.463115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 17:38:28.463115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:38:28.463115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:38:28.463115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:38:28.463115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:38:28.463115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48b5e50f-5079-438b-ac33-67623b4428f5 could not be found. Jul 12 17:38:28.463115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:38:28.463115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:38:28.463115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:38:28.463115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:38:28.463115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:38:28.463115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:38:28.463115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:38:28.463115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:38:28.463115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48b5e50f-5079-438b-ac33-67623b4428f5 could not be found. Jul 12 17:38:28.463115 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:38:28.464758 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2c388c71-29d6-47f7-a492-fef2e4617b60 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Returning 404 to user: Instance 48b5e50f-5079-438b-ac33-67623b4428f5 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:38:28.464758 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2c388c71-29d6-47f7-a492-fef2e4617b60 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "DELETE /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 404 len: 111 microversion: 2.20 time: 0.028604 Jul 12 17:38:28.464758 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 576/1184] 10.222.0.62 () {60 vars in 1279 bytes} [Tue Jul 12 17:38:28 2022] DELETE /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 17:38:28.468080 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-35f2622b-fe6a-4c46-a993-a7b213624446 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:28.468693 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-35f2622b-fe6a-4c46-a993-a7b213624446 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] [instance: 48b5e50f-5079-438b-ac33-67623b4428f5] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:28.475610 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-35f2622b-fe6a-4c46-a993-a7b213624446 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:28.476058 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-35f2622b-fe6a-4c46-a993-a7b213624446 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:28.476815 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-35f2622b-fe6a-4c46-a993-a7b213624446 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:28.477250 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-35f2622b-fe6a-4c46-a993-a7b213624446 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:28.490924 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-35f2622b-fe6a-4c46-a993-a7b213624446 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] HTTP exception thrown: Instance 48b5e50f-5079-438b-ac33-67623b4428f5 could not be found. Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-35f2622b-fe6a-4c46-a993-a7b213624446 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Request method failure captured: Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 HTTP/1.1 Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza8YWCq6igHxkDwkgh4oavPD182z4-F2IEhGSz-TaeAD8ZZzMxigLg6gYeCMYCTd914ppxmhU5Oxa7RORu-eETY3-krDgfFrxFFLeG7uePmey9a-HRjBVjOM1QxDuVIIBWmAbEq019sqt749QhT6o5MV0jMm5wUT2Dao5f_KVZ9NAII Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: a47989251b16474f830f5a46efe33812 Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-110492675 Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:38:28.492430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:38:28.494167 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a47989251b16474f830f5a46efe33812"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a47989251b16474f830f5a46efe33812"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a47989251b16474f830f5a46efe33812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a47989251b16474f830f5a46efe33812", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:38:28.494167 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeShelveTestJSON-110492675 Jul 12 17:38:28.494167 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: a47989251b16474f830f5a46efe33812 Jul 12 17:38:28.494167 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-110492675 Jul 12 17:38:28.494167 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeShelveTestJSON-110492675-project Jul 12 17:38:28.494167 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:38:28.494167 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:38:28.494167 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: 673bd0c57ab842f4925c770c8959354d Jul 12 17:38:28.494167 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeShelveTestJSON-110492675-project Jul 12 17:38:28.494167 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:38:28.494167 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Instance 48b5e50f-5079-438b-ac33-67623b4428f5 could not be found. Jul 12 17:38:28.494167 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': '48b5e50f-5079-438b-ac33-67623b4428f5'} Jul 12 17:38:28.495210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:38:28.495210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:38:28.495210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:38:28.495210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:38:28.495210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:38:28.495210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:38:28.495210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:38:28.495210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:38:28.495210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:38:28.495210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:38:28.495210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48b5e50f-5079-438b-ac33-67623b4428f5 could not be found. Jul 12 17:38:28.495210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:38:28.495210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:38:28.495210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:38:28.495210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:38:28.495210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:38:28.495210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:38:28.495210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:38:28.495210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:38:28.495210 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:38:28.496782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:38:28.496782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:38:28.496782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:38:28.496782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:38:28.496782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:38:28.496782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:38:28.496782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:38:28.496782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48b5e50f-5079-438b-ac33-67623b4428f5 could not be found. Jul 12 17:38:28.496782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:38:28.496782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:38:28.496782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:38:28.496782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:38:28.496782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:38:28.496782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:38:28.496782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:38:28.496782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:38:28.496782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48b5e50f-5079-438b-ac33-67623b4428f5 could not be found. Jul 12 17:38:28.496782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:38:28.498257 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-35f2622b-fe6a-4c46-a993-a7b213624446 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] Returning 404 to user: Instance 48b5e50f-5079-438b-ac33-67623b4428f5 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:38:28.498257 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-35f2622b-fe6a-4c46-a993-a7b213624446 tempest-AttachVolumeShelveTestJSON-110492675 tempest-AttachVolumeShelveTestJSON-110492675-project] 10.222.0.62 "GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5" status: 404 len: 111 microversion: 2.20 time: 0.030176 Jul 12 17:38:28.498257 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 609/1185] 10.222.0.62 () {60 vars in 1276 bytes} [Tue Jul 12 17:38:28 2022] GET /compute/v2.1/servers/48b5e50f-5079-438b-ac33-67623b4428f5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 12 17:38:36.852712 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2913d402-77e6-40c6-b430-e6320d59b711 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Action: 'create', calling method: .version_select at 0x7f872a3f0a60>, body: {"keypair": {"name": "tempest-keypair-1952326233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZhEO3884rGbRBCO0Br0sw1EnqRLA3XHDJKw00WbjGYvBdCUWmZz+zj9DM4fH2D4ELwy0vYIfhiGurMO9yeNDXmmbuZp4AZEhhk5gtVwf9o8s05yzVldXcLbOH7RAkf7g=="}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:38:36.867130 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-2913d402-77e6-40c6-b430-e6320d59b711 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Getting quotas for project f5c087dddd214fb881ff86e6ece45195. Resources: {'key_pairs'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:38:36.871913 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-2913d402-77e6-40c6-b430-e6320d59b711 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Getting quotas for user fc1d5c8b5b8a43799e4b191b9b10db48 and project f5c087dddd214fb881ff86e6ece45195. Resources: {'key_pairs'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:38:36.912448 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2913d402-77e6-40c6-b430-e6320d59b711 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.182163 Jul 12 17:38:36.913388 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 577/1186] 10.222.0.62 () {60 vars in 1158 bytes} [Tue Jul 12 17:38:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:38:38.274805 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-911994f7-8b32-4ff0-b909-e47777c0f970 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1416223560", "imageRef": "b19e7830-75c9-4706-bd34-4954ba6b4cc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3d64fbb-59ae-47a7-b843-c4a18e75567c"}], "security_groups": [{"name": "tempest-securitygroup--1382120869"}], "key_name": "tempest-keypair-1952326233", "user_data": "}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:38:38.381082 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.network.neutron [None req-911994f7-8b32-4ff0-b909-e47777c0f970 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] validate_networks() for [('b3d64fbb-59ae-47a7-b843-c4a18e75567c', None, None, None, None, None)] {{(pid=117938) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:38:38.482301 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=30 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:38.814126 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-911994f7-8b32-4ff0-b909-e47777c0f970 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Flavor limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:38:38.814738 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-911994f7-8b32-4ff0-b909-e47777c0f970 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Image limits 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:38:38.815355 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-911994f7-8b32-4ff0-b909-e47777c0f970 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Flavor pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:38:38.815767 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-911994f7-8b32-4ff0-b909-e47777c0f970 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Image pref 0:0:0 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:38:38.816346 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.virt.hardware [None req-911994f7-8b32-4ff0-b909-e47777c0f970 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117938) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:38:38.825377 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-911994f7-8b32-4ff0-b909-e47777c0f970 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:38.825953 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-911994f7-8b32-4ff0-b909-e47777c0f970 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:38.826953 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-911994f7-8b32-4ff0-b909-e47777c0f970 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:38.827483 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-911994f7-8b32-4ff0-b909-e47777c0f970 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:38.844229 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-911994f7-8b32-4ff0-b909-e47777c0f970 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Getting quotas for project f5c087dddd214fb881ff86e6ece45195. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:38:38.848698 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-911994f7-8b32-4ff0-b909-e47777c0f970 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Getting quotas for user fc1d5c8b5b8a43799e4b191b9b10db48 and project f5c087dddd214fb881ff86e6ece45195. Resources: {'cores', 'ram', 'instances'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:38:38.859545 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-911994f7-8b32-4ff0-b909-e47777c0f970 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Going to run 1 instances... {{(pid=117938) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:38:38.862470 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-911994f7-8b32-4ff0-b909-e47777c0f970 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19e7830-75c9-4706-bd34-4954ba6b4cc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117938) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:38:38.909363 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-911994f7-8b32-4ff0-b909-e47777c0f970 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.638758 Jul 12 17:38:38.910222 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 610/1187] 10.222.0.62 () {60 vars in 1146 bytes} [Tue Jul 12 17:38:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:38:38.917298 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:38.921443 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-acd8ea29-3cfc-49cd-878e-b513a2cc275b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:38.922098 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-acd8ea29-3cfc-49cd-878e-b513a2cc275b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:38.979745 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-acd8ea29-3cfc-49cd-878e-b513a2cc275b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:38.989261 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-acd8ea29-3cfc-49cd-878e-b513a2cc275b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1238 microversion: 2.1 time: 0.073146 Jul 12 17:38:38.998873 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 578/1188] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:38:38 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:38:40.007635 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-998be106-b785-4482-b424-be91945a8f97 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:40.009074 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-998be106-b785-4482-b424-be91945a8f97 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:40.018236 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-998be106-b785-4482-b424-be91945a8f97 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:40.018769 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-998be106-b785-4482-b424-be91945a8f97 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:40.019761 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-998be106-b785-4482-b424-be91945a8f97 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:40.020267 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-998be106-b785-4482-b424-be91945a8f97 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:40.091361 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-998be106-b785-4482-b424-be91945a8f97 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:40.100489 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-998be106-b785-4482-b424-be91945a8f97 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1242 microversion: 2.1 time: 0.097616 Jul 12 17:38:40.101043 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 611/1189] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:38:40 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:38:41.117470 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-36e291e8-2bf8-4615-a099-0f942c0de7b5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:41.118153 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-36e291e8-2bf8-4615-a099-0f942c0de7b5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:41.124787 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-36e291e8-2bf8-4615-a099-0f942c0de7b5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:41.125235 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-36e291e8-2bf8-4615-a099-0f942c0de7b5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:41.126083 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-36e291e8-2bf8-4615-a099-0f942c0de7b5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:41.126521 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-36e291e8-2bf8-4615-a099-0f942c0de7b5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:41.185667 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-36e291e8-2bf8-4615-a099-0f942c0de7b5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:41.193202 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-36e291e8-2bf8-4615-a099-0f942c0de7b5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1242 microversion: 2.1 time: 0.079608 Jul 12 17:38:41.193772 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 579/1190] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:38:41 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:38:42.209995 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-18bbab07-1a2d-4a69-9217-5a03041a762a tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:42.210529 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-18bbab07-1a2d-4a69-9217-5a03041a762a tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:42.216985 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-18bbab07-1a2d-4a69-9217-5a03041a762a tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:42.217437 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-18bbab07-1a2d-4a69-9217-5a03041a762a tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:42.218223 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-18bbab07-1a2d-4a69-9217-5a03041a762a tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:42.218666 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-18bbab07-1a2d-4a69-9217-5a03041a762a tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:42.280575 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-18bbab07-1a2d-4a69-9217-5a03041a762a tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:42.287848 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-18bbab07-1a2d-4a69-9217-5a03041a762a tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1242 microversion: 2.1 time: 0.081838 Jul 12 17:38:42.288410 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 612/1191] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:38:42 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:38:43.304334 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-59ca3cc3-003b-4164-be80-a3c27b91e017 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:43.304976 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-59ca3cc3-003b-4164-be80-a3c27b91e017 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:43.311764 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-59ca3cc3-003b-4164-be80-a3c27b91e017 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:43.312219 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-59ca3cc3-003b-4164-be80-a3c27b91e017 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:43.312987 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-59ca3cc3-003b-4164-be80-a3c27b91e017 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:43.313947 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-59ca3cc3-003b-4164-be80-a3c27b91e017 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:43.376558 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-59ca3cc3-003b-4164-be80-a3c27b91e017 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:43.384961 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-59ca3cc3-003b-4164-be80-a3c27b91e017 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1290 microversion: 2.1 time: 0.084474 Jul 12 17:38:43.385554 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 580/1192] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:38:43 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1290 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:38:44.402812 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8062cd50-35a6-49dc-b791-34614a1afe69 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:44.403947 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8062cd50-35a6-49dc-b791-34614a1afe69 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:44.410820 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8062cd50-35a6-49dc-b791-34614a1afe69 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:44.411289 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8062cd50-35a6-49dc-b791-34614a1afe69 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:44.412437 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8062cd50-35a6-49dc-b791-34614a1afe69 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:44.412994 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8062cd50-35a6-49dc-b791-34614a1afe69 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:44.647129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8062cd50-35a6-49dc-b791-34614a1afe69 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:44.654406 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8062cd50-35a6-49dc-b791-34614a1afe69 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1364 microversion: 2.1 time: 0.255669 Jul 12 17:38:44.655083 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 613/1193] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:38:44 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1364 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:38:45.094284 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-73f04341-731e-4e90-82eb-c3bcb13a9700 req-020fb2b9-590c-4cc3-a5c5-fb64a51f770b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eadcdea-7baa-4f12-a2c8-7a6506824909", "tag": "e522e7de-744a-4fc0-b4c7-1fe412e3f382"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:38:45.114675 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-73f04341-731e-4e90-82eb-c3bcb13a9700 req-020fb2b9-590c-4cc3-a5c5-fb64a51f770b service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:45.115126 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-73f04341-731e-4e90-82eb-c3bcb13a9700 req-020fb2b9-590c-4cc3-a5c5-fb64a51f770b service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:45.129482 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-73f04341-731e-4e90-82eb-c3bcb13a9700 req-020fb2b9-590c-4cc3-a5c5-fb64a51f770b service nova] Creating event network-changed:e522e7de-744a-4fc0-b4c7-1fe412e3f382 for instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 on hv-cinder-84932 Jul 12 17:38:45.136406 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-73f04341-731e-4e90-82eb-c3bcb13a9700 req-020fb2b9-590c-4cc3-a5c5-fb64a51f770b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046160 Jul 12 17:38:45.137231 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 581/1194] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:38:45.672052 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-08802258-9a13-4901-b0fc-fbe8db097887 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:45.673361 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-08802258-9a13-4901-b0fc-fbe8db097887 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:45.679875 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-08802258-9a13-4901-b0fc-fbe8db097887 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:45.680325 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-08802258-9a13-4901-b0fc-fbe8db097887 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:45.681087 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-08802258-9a13-4901-b0fc-fbe8db097887 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:45.681521 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-08802258-9a13-4901-b0fc-fbe8db097887 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:45.898880 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-08802258-9a13-4901-b0fc-fbe8db097887 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:45.907564 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-08802258-9a13-4901-b0fc-fbe8db097887 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1364 microversion: 2.1 time: 0.238812 Jul 12 17:38:45.908158 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 614/1195] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:38:45 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:38:46.925417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-07786834-157f-4be7-95ed-b4b9b3b92929 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:46.926152 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-07786834-157f-4be7-95ed-b4b9b3b92929 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:46.932918 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-07786834-157f-4be7-95ed-b4b9b3b92929 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:46.933367 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-07786834-157f-4be7-95ed-b4b9b3b92929 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:46.934165 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-07786834-157f-4be7-95ed-b4b9b3b92929 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:46.934600 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-07786834-157f-4be7-95ed-b4b9b3b92929 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:47.060304 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-07786834-157f-4be7-95ed-b4b9b3b92929 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:47.068880 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-07786834-157f-4be7-95ed-b4b9b3b92929 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1364 microversion: 2.1 time: 0.147992 Jul 12 17:38:47.069393 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 582/1196] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:38:46 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:38:48.085097 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6db0f565-b4cf-425a-904e-71003755cd15 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:48.085647 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6db0f565-b4cf-425a-904e-71003755cd15 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:48.092120 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6db0f565-b4cf-425a-904e-71003755cd15 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:48.092573 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6db0f565-b4cf-425a-904e-71003755cd15 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:48.093325 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6db0f565-b4cf-425a-904e-71003755cd15 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:48.093792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6db0f565-b4cf-425a-904e-71003755cd15 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:48.226892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6db0f565-b4cf-425a-904e-71003755cd15 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:48.234259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6db0f565-b4cf-425a-904e-71003755cd15 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1364 microversion: 2.1 time: 0.153118 Jul 12 17:38:48.234823 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 615/1197] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:38:48 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:38:49.251761 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-13061a8e-a0ba-48e8-b73a-7727f3c8be04 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:49.252395 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-13061a8e-a0ba-48e8-b73a-7727f3c8be04 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:49.254778 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=6 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:49.260191 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-13061a8e-a0ba-48e8-b73a-7727f3c8be04 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:49.260643 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-13061a8e-a0ba-48e8-b73a-7727f3c8be04 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:49.261407 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-13061a8e-a0ba-48e8-b73a-7727f3c8be04 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:49.261875 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-13061a8e-a0ba-48e8-b73a-7727f3c8be04 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:49.390179 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-13061a8e-a0ba-48e8-b73a-7727f3c8be04 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:49.398000 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-13061a8e-a0ba-48e8-b73a-7727f3c8be04 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1364 microversion: 2.1 time: 0.150132 Jul 12 17:38:49.398556 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 583/1198] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:38:49 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:38:50.415435 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-555c46a8-5ae2-4fa6-8224-2d7208069c39 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:50.415953 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-555c46a8-5ae2-4fa6-8224-2d7208069c39 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:50.417802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:50.418472 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:50.425595 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-555c46a8-5ae2-4fa6-8224-2d7208069c39 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:50.426089 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-555c46a8-5ae2-4fa6-8224-2d7208069c39 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:50.426855 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-555c46a8-5ae2-4fa6-8224-2d7208069c39 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:50.427295 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-555c46a8-5ae2-4fa6-8224-2d7208069c39 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:50.552045 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-555c46a8-5ae2-4fa6-8224-2d7208069c39 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:50.559651 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-555c46a8-5ae2-4fa6-8224-2d7208069c39 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1364 microversion: 2.1 time: 0.148251 Jul 12 17:38:50.560218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 616/1199] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:38:50 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:38:51.576495 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6ac70448-c343-4840-ab14-a8be46311c07 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:51.577133 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6ac70448-c343-4840-ab14-a8be46311c07 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:51.579471 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:51.584759 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6ac70448-c343-4840-ab14-a8be46311c07 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:51.585235 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6ac70448-c343-4840-ab14-a8be46311c07 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:51.586022 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6ac70448-c343-4840-ab14-a8be46311c07 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:51.586460 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6ac70448-c343-4840-ab14-a8be46311c07 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:51.725138 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6ac70448-c343-4840-ab14-a8be46311c07 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:51.732605 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6ac70448-c343-4840-ab14-a8be46311c07 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1364 microversion: 2.1 time: 0.160114 Jul 12 17:38:51.733166 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 584/1200] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:38:51 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:38:52.750021 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-45cc40ac-0eb1-40db-a50f-89d4b79e9a53 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:52.750617 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-45cc40ac-0eb1-40db-a50f-89d4b79e9a53 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:52.752625 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:52.758040 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-45cc40ac-0eb1-40db-a50f-89d4b79e9a53 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:52.758494 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-45cc40ac-0eb1-40db-a50f-89d4b79e9a53 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:52.759264 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-45cc40ac-0eb1-40db-a50f-89d4b79e9a53 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:52.759699 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-45cc40ac-0eb1-40db-a50f-89d4b79e9a53 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:52.889187 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-45cc40ac-0eb1-40db-a50f-89d4b79e9a53 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:52.897219 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-45cc40ac-0eb1-40db-a50f-89d4b79e9a53 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1364 microversion: 2.1 time: 0.151154 Jul 12 17:38:52.897814 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 617/1201] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:38:52 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:38:53.613010 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-b876049e-52e6-4e8e-bdb2-0a09a5c84221 req-488a5c32-2d54-4cb4-8027-341461464327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eadcdea-7baa-4f12-a2c8-7a6506824909", "name": "network-vif-plugged", "status": "completed", "tag": "e522e7de-744a-4fc0-b4c7-1fe412e3f382"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:38:53.621891 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-b876049e-52e6-4e8e-bdb2-0a09a5c84221 req-488a5c32-2d54-4cb4-8027-341461464327 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:53.622336 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-b876049e-52e6-4e8e-bdb2-0a09a5c84221 req-488a5c32-2d54-4cb4-8027-341461464327 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:53.633661 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-b876049e-52e6-4e8e-bdb2-0a09a5c84221 req-488a5c32-2d54-4cb4-8027-341461464327 service nova] Creating event network-vif-plugged:e522e7de-744a-4fc0-b4c7-1fe412e3f382 for instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 on hv-cinder-84932 Jul 12 17:38:53.638494 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-b876049e-52e6-4e8e-bdb2-0a09a5c84221 req-488a5c32-2d54-4cb4-8027-341461464327 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029551 Jul 12 17:38:53.639073 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 585/1202] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:38:53.915156 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-32d41775-c683-451b-b55d-c42fc82f07aa tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:53.915777 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-32d41775-c683-451b-b55d-c42fc82f07aa tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:53.922124 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-32d41775-c683-451b-b55d-c42fc82f07aa tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:53.922570 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-32d41775-c683-451b-b55d-c42fc82f07aa tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:53.923317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-32d41775-c683-451b-b55d-c42fc82f07aa tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:53.923743 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-32d41775-c683-451b-b55d-c42fc82f07aa tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:54.053136 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-32d41775-c683-451b-b55d-c42fc82f07aa tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:54.060458 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-32d41775-c683-451b-b55d-c42fc82f07aa tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1364 microversion: 2.1 time: 0.149502 Jul 12 17:38:54.061299 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 618/1203] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:38:53 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:38:55.079730 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-608fe056-ad89-483a-9666-fb065a137021 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:55.080431 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-608fe056-ad89-483a-9666-fb065a137021 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:55.086800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-608fe056-ad89-483a-9666-fb065a137021 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:55.087243 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-608fe056-ad89-483a-9666-fb065a137021 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:55.088003 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-608fe056-ad89-483a-9666-fb065a137021 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:55.088435 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-608fe056-ad89-483a-9666-fb065a137021 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:55.215040 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-608fe056-ad89-483a-9666-fb065a137021 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:55.222976 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-608fe056-ad89-483a-9666-fb065a137021 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1364 microversion: 2.1 time: 0.148609 Jul 12 17:38:55.223536 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 586/1204] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:38:55 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:38:56.239687 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1622d404-67e7-4017-a50f-3c97c3f0a454 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:56.240274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1622d404-67e7-4017-a50f-3c97c3f0a454 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:56.246751 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1622d404-67e7-4017-a50f-3c97c3f0a454 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:56.247196 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1622d404-67e7-4017-a50f-3c97c3f0a454 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:56.247944 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1622d404-67e7-4017-a50f-3c97c3f0a454 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:56.248372 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1622d404-67e7-4017-a50f-3c97c3f0a454 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:56.377019 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1622d404-67e7-4017-a50f-3c97c3f0a454 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:38:56.384315 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1622d404-67e7-4017-a50f-3c97c3f0a454 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1551 microversion: 2.1 time: 0.148594 Jul 12 17:38:56.384880 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 619/1205] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:38:56 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1551 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:38:56.400821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0e44b161-f1ca-462c-9ae4-a7b0c163dca5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:38:56.401342 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0e44b161-f1ca-462c-9ae4-a7b0c163dca5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:38:56.407634 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0e44b161-f1ca-462c-9ae4-a7b0c163dca5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:56.408075 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0e44b161-f1ca-462c-9ae4-a7b0c163dca5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:56.408832 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0e44b161-f1ca-462c-9ae4-a7b0c163dca5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:56.409259 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0e44b161-f1ca-462c-9ae4-a7b0c163dca5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:56.483619 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0e44b161-f1ca-462c-9ae4-a7b0c163dca5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086558 Jul 12 17:38:56.484220 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 587/1206] 10.222.0.62 () {58 vars in 1274 bytes} [Tue Jul 12 17:38:56 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:38:57.395085 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-8d84fb88-0d3d-46b2-a8c2-e6822eb36ee1 req-1beda607-646d-455d-924a-b13c84ef108c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eadcdea-7baa-4f12-a2c8-7a6506824909", "tag": "e522e7de-744a-4fc0-b4c7-1fe412e3f382"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:38:57.403511 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-8d84fb88-0d3d-46b2-a8c2-e6822eb36ee1 req-1beda607-646d-455d-924a-b13c84ef108c service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:38:57.403955 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-8d84fb88-0d3d-46b2-a8c2-e6822eb36ee1 req-1beda607-646d-455d-924a-b13c84ef108c service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:38:57.414525 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-8d84fb88-0d3d-46b2-a8c2-e6822eb36ee1 req-1beda607-646d-455d-924a-b13c84ef108c service nova] Creating event network-changed:e522e7de-744a-4fc0-b4c7-1fe412e3f382 for instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 on hv-cinder-84932 Jul 12 17:38:57.419556 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-8d84fb88-0d3d-46b2-a8c2-e6822eb36ee1 req-1beda607-646d-455d-924a-b13c84ef108c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028264 Jul 12 17:38:57.420138 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 620/1207] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:39:28.321021 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:39:28.321613 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Tue Jul 12 17:39:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:39:31.404100 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=7 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:31.405039 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=44 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:31.409435 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8d30b722-2d33-4e80-926f-fd9432b4b104 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:31.409783 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-6e91e00c-264d-4b35-a82c-aca3f13c7cf6 req-243662c6-e539-4aeb-ae5b-181e4ba26813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdfd07ca-55f6-48b2-b2c7-f202196e05ed", "tag": "78ee797f-f3e0-4e02-ba3d-1c9755d72b65"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:39:31.410231 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8d30b722-2d33-4e80-926f-fd9432b4b104 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:31.414375 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=7 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:31.415101 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=58 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:31.417887 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8d30b722-2d33-4e80-926f-fd9432b4b104 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:31.418447 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8d30b722-2d33-4e80-926f-fd9432b4b104 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:31.419230 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8d30b722-2d33-4e80-926f-fd9432b4b104 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:31.419669 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8d30b722-2d33-4e80-926f-fd9432b4b104 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:31.422044 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-6e91e00c-264d-4b35-a82c-aca3f13c7cf6 req-243662c6-e539-4aeb-ae5b-181e4ba26813 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:31.422489 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-6e91e00c-264d-4b35-a82c-aca3f13c7cf6 req-243662c6-e539-4aeb-ae5b-181e4ba26813 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:31.434333 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-6e91e00c-264d-4b35-a82c-aca3f13c7cf6 req-243662c6-e539-4aeb-ae5b-181e4ba26813 service nova] Creating event network-changed:78ee797f-f3e0-4e02-ba3d-1c9755d72b65 for instance bdfd07ca-55f6-48b2-b2c7-f202196e05ed on hv-cinder-84932 Jul 12 17:39:31.440155 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-6e91e00c-264d-4b35-a82c-aca3f13c7cf6 req-243662c6-e539-4aeb-ae5b-181e4ba26813 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033948 Jul 12 17:39:31.441078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 621/1208] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:39:31.446757 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8d30b722-2d33-4e80-926f-fd9432b4b104 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Going to try to terminate instance {{(pid=117939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:39:31.527715 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8d30b722-2d33-4e80-926f-fd9432b4b104 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "DELETE /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 204 len: 0 microversion: 2.1 time: 0.125106 Jul 12 17:39:31.528878 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 588/1209] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:39:31 2022] DELETE /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:39:31.537809 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ca54eaf8-3717-476b-88a5-515b013f7e89 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:31.539022 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ca54eaf8-3717-476b-88a5-515b013f7e89 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:31.546176 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ca54eaf8-3717-476b-88a5-515b013f7e89 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:31.546890 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ca54eaf8-3717-476b-88a5-515b013f7e89 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:31.547889 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ca54eaf8-3717-476b-88a5-515b013f7e89 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:31.548601 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ca54eaf8-3717-476b-88a5-515b013f7e89 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:31.684570 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ca54eaf8-3717-476b-88a5-515b013f7e89 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:31.693026 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ca54eaf8-3717-476b-88a5-515b013f7e89 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.159769 Jul 12 17:39:31.693594 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 622/1210] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:31 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:39:32.711550 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-2914f411-247c-48da-8d5e-1d52a0af511a tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:32.712347 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-2914f411-247c-48da-8d5e-1d52a0af511a tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:32.718631 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2914f411-247c-48da-8d5e-1d52a0af511a tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:32.719212 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2914f411-247c-48da-8d5e-1d52a0af511a tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:32.719828 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2914f411-247c-48da-8d5e-1d52a0af511a tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:32.720385 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-2914f411-247c-48da-8d5e-1d52a0af511a tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:33.162695 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-2914f411-247c-48da-8d5e-1d52a0af511a tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:33.170193 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-2914f411-247c-48da-8d5e-1d52a0af511a tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.463042 Jul 12 17:39:33.170756 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 589/1211] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:32 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:39:34.187879 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-13033d75-c053-4056-8170-088a1d362785 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:34.188485 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-13033d75-c053-4056-8170-088a1d362785 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:34.194916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13033d75-c053-4056-8170-088a1d362785 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:34.195362 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13033d75-c053-4056-8170-088a1d362785 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:34.196110 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13033d75-c053-4056-8170-088a1d362785 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:34.196542 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-13033d75-c053-4056-8170-088a1d362785 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:34.325951 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-13033d75-c053-4056-8170-088a1d362785 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:34.334022 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-13033d75-c053-4056-8170-088a1d362785 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.150248 Jul 12 17:39:34.334607 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 623/1212] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:34 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:35.351449 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-032f8592-ab01-4a39-a7e1-e0895953f46f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:35.352076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-032f8592-ab01-4a39-a7e1-e0895953f46f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:35.358273 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-032f8592-ab01-4a39-a7e1-e0895953f46f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:35.358720 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-032f8592-ab01-4a39-a7e1-e0895953f46f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:35.359469 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-032f8592-ab01-4a39-a7e1-e0895953f46f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:35.359901 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-032f8592-ab01-4a39-a7e1-e0895953f46f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:35.491890 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-032f8592-ab01-4a39-a7e1-e0895953f46f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:35.499252 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-032f8592-ab01-4a39-a7e1-e0895953f46f tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.151662 Jul 12 17:39:35.499808 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 590/1213] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:35 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:36.515775 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d8eb399d-7b9c-4aa6-b3da-0755b7838c6d tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:36.516412 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d8eb399d-7b9c-4aa6-b3da-0755b7838c6d tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:36.522852 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d8eb399d-7b9c-4aa6-b3da-0755b7838c6d tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:36.523295 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d8eb399d-7b9c-4aa6-b3da-0755b7838c6d tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:36.524040 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d8eb399d-7b9c-4aa6-b3da-0755b7838c6d tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:36.524469 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d8eb399d-7b9c-4aa6-b3da-0755b7838c6d tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:36.656102 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d8eb399d-7b9c-4aa6-b3da-0755b7838c6d tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:36.663894 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d8eb399d-7b9c-4aa6-b3da-0755b7838c6d tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.151986 Jul 12 17:39:36.664456 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 624/1214] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:36 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:37.680361 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5a0ed824-595d-4e10-8234-d208a866d574 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:37.680989 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5a0ed824-595d-4e10-8234-d208a866d574 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:37.687927 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5a0ed824-595d-4e10-8234-d208a866d574 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:37.688385 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5a0ed824-595d-4e10-8234-d208a866d574 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:37.689836 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5a0ed824-595d-4e10-8234-d208a866d574 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:37.690280 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5a0ed824-595d-4e10-8234-d208a866d574 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:37.791623 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-59038bae-fdaa-4d80-84e3-fca604459c48 req-13166084-668b-4cff-8a03-e84175f1f9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdfd07ca-55f6-48b2-b2c7-f202196e05ed", "name": "network-vif-unplugged", "status": "completed", "tag": "78ee797f-f3e0-4e02-ba3d-1c9755d72b65"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:39:37.802404 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-59038bae-fdaa-4d80-84e3-fca604459c48 req-13166084-668b-4cff-8a03-e84175f1f9c6 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:37.802927 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-59038bae-fdaa-4d80-84e3-fca604459c48 req-13166084-668b-4cff-8a03-e84175f1f9c6 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:37.815130 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-59038bae-fdaa-4d80-84e3-fca604459c48 req-13166084-668b-4cff-8a03-e84175f1f9c6 service nova] Creating event network-vif-unplugged:78ee797f-f3e0-4e02-ba3d-1c9755d72b65 for instance bdfd07ca-55f6-48b2-b2c7-f202196e05ed on hv-cinder-84932 Jul 12 17:39:37.820143 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-59038bae-fdaa-4d80-84e3-fca604459c48 req-13166084-668b-4cff-8a03-e84175f1f9c6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033220 Jul 12 17:39:37.820745 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 625/1215] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:39:37.828431 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-5a0ed824-595d-4e10-8234-d208a866d574 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:37.835897 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5a0ed824-595d-4e10-8234-d208a866d574 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1567 microversion: 2.1 time: 0.159402 Jul 12 17:39:37.836466 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 591/1216] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:37 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:38.852782 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-3c200522-ba80-4b0d-a86c-e474e12e6c8a tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:38.853578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-3c200522-ba80-4b0d-a86c-e474e12e6c8a tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:38.859900 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3c200522-ba80-4b0d-a86c-e474e12e6c8a tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:38.860356 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3c200522-ba80-4b0d-a86c-e474e12e6c8a tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:38.861131 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3c200522-ba80-4b0d-a86c-e474e12e6c8a tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:38.861633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-3c200522-ba80-4b0d-a86c-e474e12e6c8a tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:39.048646 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-3c200522-ba80-4b0d-a86c-e474e12e6c8a tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd18bd359544360af0956a4567cf09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a054b68c85844739e5df76de96a12e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:39:39.056247 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-3c200522-ba80-4b0d-a86c-e474e12e6c8a tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 200 len: 1448 microversion: 2.1 time: 0.208108 Jul 12 17:39:39.056856 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 626/1217] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:38 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 1448 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:39:39.184791 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-fec706cb-414f-4e0b-9a67-9bad12e5a346 req-0b3e9ed1-5097-48d4-b0e1-e513bc64cc97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdfd07ca-55f6-48b2-b2c7-f202196e05ed", "name": "network-vif-deleted", "tag": "78ee797f-f3e0-4e02-ba3d-1c9755d72b65"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:39:39.194181 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-fec706cb-414f-4e0b-9a67-9bad12e5a346 req-0b3e9ed1-5097-48d4-b0e1-e513bc64cc97 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:39.194625 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-fec706cb-414f-4e0b-9a67-9bad12e5a346 req-0b3e9ed1-5097-48d4-b0e1-e513bc64cc97 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:39.205608 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-fec706cb-414f-4e0b-9a67-9bad12e5a346 req-0b3e9ed1-5097-48d4-b0e1-e513bc64cc97 service nova] Creating event network-vif-deleted:78ee797f-f3e0-4e02-ba3d-1c9755d72b65 for instance bdfd07ca-55f6-48b2-b2c7-f202196e05ed on hv-cinder-84932 Jul 12 17:39:39.210650 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-fec706cb-414f-4e0b-9a67-9bad12e5a346 req-0b3e9ed1-5097-48d4-b0e1-e513bc64cc97 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029472 Jul 12 17:39:39.211260 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 592/1218] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:39:40.073834 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7e7fc4e1-f775-4ad3-886a-af14dd5b65bf tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:40.074454 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-7e7fc4e1-f775-4ad3-886a-af14dd5b65bf tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] [instance: bdfd07ca-55f6-48b2-b2c7-f202196e05ed] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:39:40.081542 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7e7fc4e1-f775-4ad3-886a-af14dd5b65bf tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:40.082027 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7e7fc4e1-f775-4ad3-886a-af14dd5b65bf tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:40.082784 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7e7fc4e1-f775-4ad3-886a-af14dd5b65bf tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:39:40.083216 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-7e7fc4e1-f775-4ad3-886a-af14dd5b65bf tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:39:40.096345 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-7e7fc4e1-f775-4ad3-886a-af14dd5b65bf tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] HTTP exception thrown: Instance bdfd07ca-55f6-48b2-b2c7-f202196e05ed could not be found. Jul 12 17:39:40.098053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7e7fc4e1-f775-4ad3-886a-af14dd5b65bf tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Request method failure captured: Jul 12 17:39:40.098053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed HTTP/1.1 Jul 12 17:39:40.098053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:39:40.098053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:39:40.098053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:39:40.098053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:39:40.098053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:39:40.098053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:39:40.098053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:39:40.098053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:39:40.098053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizbAz70sHTB17jYcvINzGrTAuC9oSM_q1Lq-DqYDSS8126_yg8CfP4D0vmnBzBvJFEbdde8X3o5yQGdJVexYazv_dA-DDkvd1rAx1qLVX5_aDCldXsEKtfwHZBAOls6XEixfuM9rsB13agfgFVHrM_DNArgZAU_Bh--VXCGJC3xahT-o Jul 12 17:39:40.098053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:39:40.098053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:39:40.098053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:39:40.098053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:39:40.098053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:39:40.098053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:39:40.098053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: 6a054b68c85844739e5df76de96a12e7 Jul 12 17:39:40.098053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-TestShelveInstance-877192269 Jul 12 17:39:40.098053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:39:40.098053 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:39:40.099813 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a054b68c85844739e5df76de96a12e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6a054b68c85844739e5df76de96a12e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6a054b68c85844739e5df76de96a12e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6a054b68c85844739e5df76de96a12e7", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:39:40.099813 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-TestShelveInstance-877192269 Jul 12 17:39:40.099813 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 6a054b68c85844739e5df76de96a12e7 Jul 12 17:39:40.099813 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-TestShelveInstance-877192269 Jul 12 17:39:40.099813 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-TestShelveInstance-877192269-project Jul 12 17:39:40.099813 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:39:40.099813 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:39:40.099813 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: 5bd18bd359544360af0956a4567cf09d Jul 12 17:39:40.099813 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-TestShelveInstance-877192269-project Jul 12 17:39:40.099813 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:39:40.099813 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Instance bdfd07ca-55f6-48b2-b2c7-f202196e05ed could not be found. Jul 12 17:39:40.099813 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': 'bdfd07ca-55f6-48b2-b2c7-f202196e05ed'} Jul 12 17:39:40.100892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:39:40.100892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:39:40.100892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:39:40.100892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:39:40.100892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:39:40.100892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:39:40.100892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:39:40.100892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:39:40.100892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:39:40.100892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:39:40.100892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdfd07ca-55f6-48b2-b2c7-f202196e05ed could not be found. Jul 12 17:39:40.100892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:39:40.100892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:39:40.100892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:39:40.100892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:39:40.100892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:39:40.100892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:39:40.100892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:39:40.100892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:39:40.100892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:39:40.102638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:39:40.102638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:39:40.102638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:39:40.102638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:39:40.102638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:39:40.102638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:39:40.102638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:39:40.102638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdfd07ca-55f6-48b2-b2c7-f202196e05ed could not be found. Jul 12 17:39:40.102638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:39:40.102638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:39:40.102638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:39:40.102638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:39:40.102638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:39:40.102638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:39:40.102638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:39:40.102638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:39:40.102638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdfd07ca-55f6-48b2-b2c7-f202196e05ed could not be found. Jul 12 17:39:40.102638 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:39:40.104420 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-7e7fc4e1-f775-4ad3-886a-af14dd5b65bf tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Returning 404 to user: Instance bdfd07ca-55f6-48b2-b2c7-f202196e05ed could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:39:40.104420 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-7e7fc4e1-f775-4ad3-886a-af14dd5b65bf tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed" status: 404 len: 111 microversion: 2.1 time: 0.029528 Jul 12 17:39:40.104420 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 627/1219] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:39:40 2022] GET /compute/v2.1/servers/bdfd07ca-55f6-48b2-b2c7-f202196e05ed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:39:40.259726 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-3f226fd3-0843-45ea-b3cc-d61b57bf9179 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] Calling method '.version_select at 0x7f8729725670>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:39:40.277123 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-3f226fd3-0843-45ea-b3cc-d61b57bf9179 tempest-TestShelveInstance-877192269 tempest-TestShelveInstance-877192269-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-230823032" status: 202 len: 0 microversion: 2.1 time: 0.022056 Jul 12 17:39:40.277990 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 593/1220] 10.222.0.62 () {58 vars in 1250 bytes} [Tue Jul 12 17:39:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-230823032 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:40:02.099061 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:02.099815 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-96f9f1b7-0ab7-45fc-a14a-2e13ad9b9cf9 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:02.100441 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-96f9f1b7-0ab7-45fc-a14a-2e13ad9b9cf9 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:02.100604 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:02.102838 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=14 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:02.103640 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=30 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:02.104337 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-3f71e28f-f7a9-4834-b03a-90b7c39e3c92 req-84344516-d87b-4e1a-b989-a24ffeda17ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659c2528-8d70-483d-8fa3-dad061e504cb", "tag": "69957ac6-cba3-4a17-bf8c-7ef2a062fe49"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:40:02.109616 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96f9f1b7-0ab7-45fc-a14a-2e13ad9b9cf9 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:02.110216 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96f9f1b7-0ab7-45fc-a14a-2e13ad9b9cf9 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:02.110996 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96f9f1b7-0ab7-45fc-a14a-2e13ad9b9cf9 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:02.111501 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-96f9f1b7-0ab7-45fc-a14a-2e13ad9b9cf9 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:02.115103 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-3f71e28f-f7a9-4834-b03a-90b7c39e3c92 req-84344516-d87b-4e1a-b989-a24ffeda17ad service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:02.115612 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-3f71e28f-f7a9-4834-b03a-90b7c39e3c92 req-84344516-d87b-4e1a-b989-a24ffeda17ad service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:02.128435 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-3f71e28f-f7a9-4834-b03a-90b7c39e3c92 req-84344516-d87b-4e1a-b989-a24ffeda17ad service nova] Creating event network-changed:69957ac6-cba3-4a17-bf8c-7ef2a062fe49 for instance 659c2528-8d70-483d-8fa3-dad061e504cb on hv-cinder-84932 Jul 12 17:40:02.134614 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-3f71e28f-f7a9-4834-b03a-90b7c39e3c92 req-84344516-d87b-4e1a-b989-a24ffeda17ad service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036836 Jul 12 17:40:02.135443 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 594/1221] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:40:02.142387 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-96f9f1b7-0ab7-45fc-a14a-2e13ad9b9cf9 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:40:02.229317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-96f9f1b7-0ab7-45fc-a14a-2e13ad9b9cf9 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "DELETE /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 204 len: 0 microversion: 2.1 time: 0.133034 Jul 12 17:40:02.230805 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 628/1222] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:40:02 2022] DELETE /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:40:02.239147 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d7bff191-f98d-439b-8b3f-130591d8b94c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:02.239854 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d7bff191-f98d-439b-8b3f-130591d8b94c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:02.247694 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d7bff191-f98d-439b-8b3f-130591d8b94c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:02.248145 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d7bff191-f98d-439b-8b3f-130591d8b94c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:02.248927 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d7bff191-f98d-439b-8b3f-130591d8b94c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:02.249480 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d7bff191-f98d-439b-8b3f-130591d8b94c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:02.381344 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-d7bff191-f98d-439b-8b3f-130591d8b94c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:02.388717 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d7bff191-f98d-439b-8b3f-130591d8b94c tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1578 microversion: 2.1 time: 0.154069 Jul 12 17:40:02.389273 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 595/1223] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:02 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:03.408359 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-834055d3-3e0f-4a15-8f69-10fc1fc06f08 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:03.409096 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-834055d3-3e0f-4a15-8f69-10fc1fc06f08 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:03.415454 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-834055d3-3e0f-4a15-8f69-10fc1fc06f08 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:03.415904 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-834055d3-3e0f-4a15-8f69-10fc1fc06f08 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:03.416668 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-834055d3-3e0f-4a15-8f69-10fc1fc06f08 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:03.417111 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-834055d3-3e0f-4a15-8f69-10fc1fc06f08 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:03.619254 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-834055d3-3e0f-4a15-8f69-10fc1fc06f08 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:03.626739 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-834055d3-3e0f-4a15-8f69-10fc1fc06f08 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1578 microversion: 2.1 time: 0.222590 Jul 12 17:40:03.627306 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 629/1224] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:03 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1578 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:04.643866 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-fcead223-30d8-4f6e-817d-b96b737de312 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:04.644490 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-fcead223-30d8-4f6e-817d-b96b737de312 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:04.651043 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fcead223-30d8-4f6e-817d-b96b737de312 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:04.651513 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fcead223-30d8-4f6e-817d-b96b737de312 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:04.652284 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fcead223-30d8-4f6e-817d-b96b737de312 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:04.652725 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-fcead223-30d8-4f6e-817d-b96b737de312 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:04.684035 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-a96be2ec-c912-4a5a-b26f-cce5034666ee req-9bf0045e-94dc-4637-bdca-a2f99c44f918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659c2528-8d70-483d-8fa3-dad061e504cb", "name": "network-vif-deleted", "tag": "69957ac6-cba3-4a17-bf8c-7ef2a062fe49"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:40:04.700275 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-a96be2ec-c912-4a5a-b26f-cce5034666ee req-9bf0045e-94dc-4637-bdca-a2f99c44f918 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:04.701074 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-a96be2ec-c912-4a5a-b26f-cce5034666ee req-9bf0045e-94dc-4637-bdca-a2f99c44f918 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:04.712950 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-a96be2ec-c912-4a5a-b26f-cce5034666ee req-9bf0045e-94dc-4637-bdca-a2f99c44f918 service nova] Creating event network-vif-deleted:69957ac6-cba3-4a17-bf8c-7ef2a062fe49 for instance 659c2528-8d70-483d-8fa3-dad061e504cb on hv-cinder-84932 Jul 12 17:40:04.718561 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-a96be2ec-c912-4a5a-b26f-cce5034666ee req-9bf0045e-94dc-4637-bdca-a2f99c44f918 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037939 Jul 12 17:40:04.719179 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 630/1225] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:40:04.740776 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-fcead223-30d8-4f6e-817d-b96b737de312 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:04.748382 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-fcead223-30d8-4f6e-817d-b96b737de312 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 200 len: 1392 microversion: 2.1 time: 0.108387 Jul 12 17:40:04.748971 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 596/1226] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:04 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 1392 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:05.768116 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cc88d684-1565-41c2-9f53-b30284388d3f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:05.769400 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-cc88d684-1565-41c2-9f53-b30284388d3f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 659c2528-8d70-483d-8fa3-dad061e504cb] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:05.777074 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cc88d684-1565-41c2-9f53-b30284388d3f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:05.777515 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cc88d684-1565-41c2-9f53-b30284388d3f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:05.778946 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cc88d684-1565-41c2-9f53-b30284388d3f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:05.779418 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-cc88d684-1565-41c2-9f53-b30284388d3f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:05.794132 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-cc88d684-1565-41c2-9f53-b30284388d3f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] HTTP exception thrown: Instance 659c2528-8d70-483d-8fa3-dad061e504cb could not be found. Jul 12 17:40:05.795766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cc88d684-1565-41c2-9f53-b30284388d3f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Request method failure captured: Jul 12 17:40:05.795766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb HTTP/1.1 Jul 12 17:40:05.795766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:40:05.795766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:40:05.795766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:40:05.795766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:40:05.795766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:40:05.795766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:40:05.795766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:40:05.795766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:40:05.795766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza-TAjWcHaOSpqkySXwtb2WNZD2BFD3qEUKFTEDhpJWu4v5zBpIvQd0dbUHnTgGxpYcI8fsjfzYhzMBG3txmDl3KHYEAVBooKP4TzbKv8urkgfMv4Ld9fgYL3eylu_bzQrt0j1ojfL_66HTGtsm7pvbc14q-abmsGJC-Cf3FAaJ8dfw Jul 12 17:40:05.795766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:40:05.795766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:40:05.795766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:40:05.795766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:40:05.795766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:40:05.795766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:40:05.795766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: 471e1e958b29427eb024616ca403985f Jul 12 17:40:05.795766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-TestVolumeBootPattern-1374833581 Jul 12 17:40:05.795766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:40:05.795766 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:40:05.797406 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/471e1e958b29427eb024616ca403985f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/471e1e958b29427eb024616ca403985f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/471e1e958b29427eb024616ca403985f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_471e1e958b29427eb024616ca403985f", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:40:05.797406 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-TestVolumeBootPattern-1374833581 Jul 12 17:40:05.797406 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 471e1e958b29427eb024616ca403985f Jul 12 17:40:05.797406 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-TestVolumeBootPattern-1374833581 Jul 12 17:40:05.797406 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-TestVolumeBootPattern-1374833581-project Jul 12 17:40:05.797406 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:40:05.797406 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:40:05.797406 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: 4e066a1d960f48d2ad78d13fc723f54e Jul 12 17:40:05.797406 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-TestVolumeBootPattern-1374833581-project Jul 12 17:40:05.797406 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:40:05.797406 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Instance 659c2528-8d70-483d-8fa3-dad061e504cb could not be found. Jul 12 17:40:05.797406 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': '659c2528-8d70-483d-8fa3-dad061e504cb'} Jul 12 17:40:05.798718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:40:05.798718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:05.798718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:40:05.798718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:40:05.798718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:40:05.798718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:40:05.798718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:40:05.798718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:40:05.798718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:40:05.798718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:40:05.798718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 659c2528-8d70-483d-8fa3-dad061e504cb could not be found. Jul 12 17:40:05.798718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:40:05.798718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:40:05.798718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:40:05.798718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:05.798718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:40:05.798718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:40:05.798718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:40:05.798718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:40:05.798718 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:40:05.801062 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:40:05.801062 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:40:05.801062 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:40:05.801062 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:40:05.801062 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:40:05.801062 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:40:05.801062 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:40:05.801062 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 659c2528-8d70-483d-8fa3-dad061e504cb could not be found. Jul 12 17:40:05.801062 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:40:05.801062 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:40:05.801062 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:40:05.801062 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:05.801062 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:40:05.801062 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:40:05.801062 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:40:05.801062 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:40:05.801062 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 659c2528-8d70-483d-8fa3-dad061e504cb could not be found. Jul 12 17:40:05.801062 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:40:05.802872 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-cc88d684-1565-41c2-9f53-b30284388d3f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Returning 404 to user: Instance 659c2528-8d70-483d-8fa3-dad061e504cb could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:40:05.802872 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-cc88d684-1565-41c2-9f53-b30284388d3f tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb" status: 404 len: 111 microversion: 2.1 time: 0.034414 Jul 12 17:40:05.802872 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 631/1227] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:05 2022] GET /compute/v2.1/servers/659c2528-8d70-483d-8fa3-dad061e504cb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:40:09.042617 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-223a87b5-1734-4600-9ad4-7995765a4676 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:09.043209 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-223a87b5-1734-4600-9ad4-7995765a4676 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:09.044785 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-3807d9a0-1db4-4948-b6b4-0d4bd64dcf11 req-1b903929-38ee-43f6-8c2d-bc937dad8be1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "231ee55e-2eb4-48b5-9f95-845118f6dbd6", "tag": "688cf221-c835-44dd-84c1-37bb5d407d77"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:40:09.051123 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-223a87b5-1734-4600-9ad4-7995765a4676 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:09.051656 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-223a87b5-1734-4600-9ad4-7995765a4676 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:09.052688 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-223a87b5-1734-4600-9ad4-7995765a4676 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:09.053204 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-223a87b5-1734-4600-9ad4-7995765a4676 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:09.054549 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-3807d9a0-1db4-4948-b6b4-0d4bd64dcf11 req-1b903929-38ee-43f6-8c2d-bc937dad8be1 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:09.055088 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-3807d9a0-1db4-4948-b6b4-0d4bd64dcf11 req-1b903929-38ee-43f6-8c2d-bc937dad8be1 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:09.071543 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-3807d9a0-1db4-4948-b6b4-0d4bd64dcf11 req-1b903929-38ee-43f6-8c2d-bc937dad8be1 service nova] Creating event network-changed:688cf221-c835-44dd-84c1-37bb5d407d77 for instance 231ee55e-2eb4-48b5-9f95-845118f6dbd6 on hv-cinder-84932 Jul 12 17:40:09.077077 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-3807d9a0-1db4-4948-b6b4-0d4bd64dcf11 req-1b903929-38ee-43f6-8c2d-bc937dad8be1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036072 Jul 12 17:40:09.078153 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 632/1228] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:40:09.080147 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-223a87b5-1734-4600-9ad4-7995765a4676 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Going to try to terminate instance {{(pid=117939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:40:09.157431 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-223a87b5-1734-4600-9ad4-7995765a4676 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "DELETE /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 204 len: 0 microversion: 2.1 time: 0.118448 Jul 12 17:40:09.158271 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 597/1229] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:40:09 2022] DELETE /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:40:09.171680 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-70005763-5e1a-4f6b-be49-e9cff5649be2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:09.177713 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-70005763-5e1a-4f6b-be49-e9cff5649be2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:09.186317 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-70005763-5e1a-4f6b-be49-e9cff5649be2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:09.187792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-70005763-5e1a-4f6b-be49-e9cff5649be2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:09.188495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-70005763-5e1a-4f6b-be49-e9cff5649be2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:09.188929 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-70005763-5e1a-4f6b-be49-e9cff5649be2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:09.323341 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-70005763-5e1a-4f6b-be49-e9cff5649be2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:09.331371 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-70005763-5e1a-4f6b-be49-e9cff5649be2 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1577 microversion: 2.1 time: 0.166751 Jul 12 17:40:09.332087 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 633/1230] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:09 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:10.349736 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-56383ff6-393b-4d78-898e-bed9ad64b5ef tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:10.350421 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-56383ff6-393b-4d78-898e-bed9ad64b5ef tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:10.356780 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-56383ff6-393b-4d78-898e-bed9ad64b5ef tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:10.357222 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-56383ff6-393b-4d78-898e-bed9ad64b5ef tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:10.358021 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-56383ff6-393b-4d78-898e-bed9ad64b5ef tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:10.358448 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-56383ff6-393b-4d78-898e-bed9ad64b5ef tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:10.534973 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-56383ff6-393b-4d78-898e-bed9ad64b5ef tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e066a1d960f48d2ad78d13fc723f54e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '471e1e958b29427eb024616ca403985f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:10.542625 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-56383ff6-393b-4d78-898e-bed9ad64b5ef tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 200 len: 1459 microversion: 2.1 time: 0.198020 Jul 12 17:40:10.543360 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 598/1231] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:10 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 1459 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:10.641860 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-5dfef73f-0fe7-4d6f-8651-016821195af9 req-536a9a77-9366-4757-aecd-28ed5bef0f08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "231ee55e-2eb4-48b5-9f95-845118f6dbd6", "name": "network-vif-deleted", "tag": "688cf221-c835-44dd-84c1-37bb5d407d77"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:40:10.650798 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-5dfef73f-0fe7-4d6f-8651-016821195af9 req-536a9a77-9366-4757-aecd-28ed5bef0f08 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:10.651236 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-5dfef73f-0fe7-4d6f-8651-016821195af9 req-536a9a77-9366-4757-aecd-28ed5bef0f08 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:10.662621 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-5dfef73f-0fe7-4d6f-8651-016821195af9 req-536a9a77-9366-4757-aecd-28ed5bef0f08 service nova] Creating event network-vif-deleted:688cf221-c835-44dd-84c1-37bb5d407d77 for instance 231ee55e-2eb4-48b5-9f95-845118f6dbd6 on hv-cinder-84932 Jul 12 17:40:10.667454 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-5dfef73f-0fe7-4d6f-8651-016821195af9 req-536a9a77-9366-4757-aecd-28ed5bef0f08 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029289 Jul 12 17:40:10.668400 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 634/1232] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:40:11.560535 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4e21ef06-7d19-431d-a75e-29c6c8b0c645 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:11.561189 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4e21ef06-7d19-431d-a75e-29c6c8b0c645 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 231ee55e-2eb4-48b5-9f95-845118f6dbd6] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:11.568274 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4e21ef06-7d19-431d-a75e-29c6c8b0c645 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:11.568722 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4e21ef06-7d19-431d-a75e-29c6c8b0c645 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:11.569476 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4e21ef06-7d19-431d-a75e-29c6c8b0c645 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:11.569939 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4e21ef06-7d19-431d-a75e-29c6c8b0c645 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:11.582875 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-4e21ef06-7d19-431d-a75e-29c6c8b0c645 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] HTTP exception thrown: Instance 231ee55e-2eb4-48b5-9f95-845118f6dbd6 could not be found. Jul 12 17:40:11.584442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4e21ef06-7d19-431d-a75e-29c6c8b0c645 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Request method failure captured: Jul 12 17:40:11.584442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 HTTP/1.1 Jul 12 17:40:11.584442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:40:11.584442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:40:11.584442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:40:11.584442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:40:11.584442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:40:11.584442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:40:11.584442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:40:11.584442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:40:11.584442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza-TAjWcHaOSpqkySXwtb2WNZD2BFD3qEUKFTEDhpJWu4v5zBpIvQd0dbUHnTgGxpYcI8fsjfzYhzMBG3txmDl3KHYEAVBooKP4TzbKv8urkgfMv4Ld9fgYL3eylu_bzQrt0j1ojfL_66HTGtsm7pvbc14q-abmsGJC-Cf3FAaJ8dfw Jul 12 17:40:11.584442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:40:11.584442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:40:11.584442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:40:11.584442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:40:11.584442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:40:11.584442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:40:11.584442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: 471e1e958b29427eb024616ca403985f Jul 12 17:40:11.584442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-TestVolumeBootPattern-1374833581 Jul 12 17:40:11.584442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:40:11.584442 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:40:11.586081 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/471e1e958b29427eb024616ca403985f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/471e1e958b29427eb024616ca403985f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/471e1e958b29427eb024616ca403985f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_471e1e958b29427eb024616ca403985f", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:40:11.586081 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-TestVolumeBootPattern-1374833581 Jul 12 17:40:11.586081 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 471e1e958b29427eb024616ca403985f Jul 12 17:40:11.586081 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-TestVolumeBootPattern-1374833581 Jul 12 17:40:11.586081 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-TestVolumeBootPattern-1374833581-project Jul 12 17:40:11.586081 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:40:11.586081 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:40:11.586081 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: 4e066a1d960f48d2ad78d13fc723f54e Jul 12 17:40:11.586081 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-TestVolumeBootPattern-1374833581-project Jul 12 17:40:11.586081 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:40:11.586081 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance 231ee55e-2eb4-48b5-9f95-845118f6dbd6 could not be found. Jul 12 17:40:11.586081 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': '231ee55e-2eb4-48b5-9f95-845118f6dbd6'} Jul 12 17:40:11.587035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:40:11.587035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:11.587035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:40:11.587035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:40:11.587035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:40:11.587035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:40:11.587035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:40:11.587035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:40:11.587035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:40:11.587035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:40:11.587035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 231ee55e-2eb4-48b5-9f95-845118f6dbd6 could not be found. Jul 12 17:40:11.587035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:40:11.587035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:40:11.587035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:40:11.587035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:11.587035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:40:11.587035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:40:11.587035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:40:11.587035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:40:11.587035 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:40:11.588551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:40:11.588551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:40:11.588551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:40:11.588551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:40:11.588551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:40:11.588551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:40:11.588551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:40:11.588551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 231ee55e-2eb4-48b5-9f95-845118f6dbd6 could not be found. Jul 12 17:40:11.588551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:40:11.588551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:40:11.588551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:40:11.588551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:11.588551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:40:11.588551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:40:11.588551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:40:11.588551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:40:11.588551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 231ee55e-2eb4-48b5-9f95-845118f6dbd6 could not be found. Jul 12 17:40:11.588551 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:40:11.589961 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4e21ef06-7d19-431d-a75e-29c6c8b0c645 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Returning 404 to user: Instance 231ee55e-2eb4-48b5-9f95-845118f6dbd6 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:40:11.589961 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4e21ef06-7d19-431d-a75e-29c6c8b0c645 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6" status: 404 len: 111 microversion: 2.1 time: 0.029459 Jul 12 17:40:11.589961 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 599/1233] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:11 2022] GET /compute/v2.1/servers/231ee55e-2eb4-48b5-9f95-845118f6dbd6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:40:12.015494 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-91c68797-530e-4e23-affc-46aa25d06f20 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:12.016073 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-91c68797-530e-4e23-affc-46aa25d06f20 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:12.022163 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91c68797-530e-4e23-affc-46aa25d06f20 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:12.022608 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91c68797-530e-4e23-affc-46aa25d06f20 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:12.023371 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91c68797-530e-4e23-affc-46aa25d06f20 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:12.023802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-91c68797-530e-4e23-affc-46aa25d06f20 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:12.037184 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-91c68797-530e-4e23-affc-46aa25d06f20 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] HTTP exception thrown: Instance 75a152ab-692f-42e7-9c24-a69291f449ae could not be found. Jul 12 17:40:12.038842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-91c68797-530e-4e23-affc-46aa25d06f20 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Request method failure captured: Jul 12 17:40:12.038842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: DELETE /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae HTTP/1.1 Jul 12 17:40:12.038842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:40:12.038842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:40:12.038842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:40:12.038842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:40:12.038842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:40:12.038842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:40:12.038842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:40:12.038842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:40:12.038842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABiza-TAjWcHaOSpqkySXwtb2WNZD2BFD3qEUKFTEDhpJWu4v5zBpIvQd0dbUHnTgGxpYcI8fsjfzYhzMBG3txmDl3KHYEAVBooKP4TzbKv8urkgfMv4Ld9fgYL3eylu_bzQrt0j1ojfL_66HTGtsm7pvbc14q-abmsGJC-Cf3FAaJ8dfw Jul 12 17:40:12.038842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:40:12.038842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:40:12.038842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:40:12.038842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:40:12.038842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:40:12.038842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:40:12.038842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: 471e1e958b29427eb024616ca403985f Jul 12 17:40:12.038842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-TestVolumeBootPattern-1374833581 Jul 12 17:40:12.038842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:40:12.038842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:40:12.040536 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/471e1e958b29427eb024616ca403985f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/471e1e958b29427eb024616ca403985f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/471e1e958b29427eb024616ca403985f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_471e1e958b29427eb024616ca403985f", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:40:12.040536 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-TestVolumeBootPattern-1374833581 Jul 12 17:40:12.040536 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: 471e1e958b29427eb024616ca403985f Jul 12 17:40:12.040536 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-TestVolumeBootPattern-1374833581 Jul 12 17:40:12.040536 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-TestVolumeBootPattern-1374833581-project Jul 12 17:40:12.040536 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:40:12.040536 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:40:12.040536 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: 4e066a1d960f48d2ad78d13fc723f54e Jul 12 17:40:12.040536 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-TestVolumeBootPattern-1374833581-project Jul 12 17:40:12.040536 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:40:12.040536 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Instance 75a152ab-692f-42e7-9c24-a69291f449ae could not be found. Jul 12 17:40:12.040536 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': '75a152ab-692f-42e7-9c24-a69291f449ae'} Jul 12 17:40:12.041495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:40:12.041495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:12.041495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:40:12.041495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:40:12.041495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:40:12.041495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:40:12.041495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:40:12.041495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:40:12.041495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:40:12.041495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:40:12.041495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a152ab-692f-42e7-9c24-a69291f449ae could not be found. Jul 12 17:40:12.041495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:40:12.041495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:40:12.041495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:40:12.041495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:12.041495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:40:12.041495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:40:12.041495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:40:12.041495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:40:12.041495 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:40:12.043078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:40:12.043078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 17:40:12.043078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 17:40:12.043078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 17:40:12.043078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 17:40:12.043078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:40:12.043078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:40:12.043078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:40:12.043078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:40:12.043078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a152ab-692f-42e7-9c24-a69291f449ae could not be found. Jul 12 17:40:12.043078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:40:12.043078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:40:12.043078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:40:12.043078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:12.043078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:40:12.043078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:40:12.043078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:40:12.043078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:40:12.043078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a152ab-692f-42e7-9c24-a69291f449ae could not be found. Jul 12 17:40:12.043078 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:40:12.044640 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-91c68797-530e-4e23-affc-46aa25d06f20 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Returning 404 to user: Instance 75a152ab-692f-42e7-9c24-a69291f449ae could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:40:12.044640 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-91c68797-530e-4e23-affc-46aa25d06f20 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "DELETE /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 404 len: 111 microversion: 2.1 time: 0.029397 Jul 12 17:40:12.044640 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 635/1234] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:40:12 2022] DELETE /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:40:12.048869 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-20924f40-85d9-463f-bcfe-21c274ccb6b6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:12.050159 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-20924f40-85d9-463f-bcfe-21c274ccb6b6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] [instance: 75a152ab-692f-42e7-9c24-a69291f449ae] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:12.057173 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-20924f40-85d9-463f-bcfe-21c274ccb6b6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:12.057622 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-20924f40-85d9-463f-bcfe-21c274ccb6b6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:12.058420 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-20924f40-85d9-463f-bcfe-21c274ccb6b6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:12.058859 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-20924f40-85d9-463f-bcfe-21c274ccb6b6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:12.072496 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-20924f40-85d9-463f-bcfe-21c274ccb6b6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] HTTP exception thrown: Instance 75a152ab-692f-42e7-9c24-a69291f449ae could not be found. Jul 12 17:40:12.074051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-20924f40-85d9-463f-bcfe-21c274ccb6b6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Request method failure captured: Jul 12 17:40:12.074051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae HTTP/1.1 Jul 12 17:40:12.074051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:40:12.074051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:40:12.074051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:40:12.074051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:40:12.074051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:40:12.074051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:40:12.074051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:40:12.074051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:40:12.074051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABiza-TAjWcHaOSpqkySXwtb2WNZD2BFD3qEUKFTEDhpJWu4v5zBpIvQd0dbUHnTgGxpYcI8fsjfzYhzMBG3txmDl3KHYEAVBooKP4TzbKv8urkgfMv4Ld9fgYL3eylu_bzQrt0j1ojfL_66HTGtsm7pvbc14q-abmsGJC-Cf3FAaJ8dfw Jul 12 17:40:12.074051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:40:12.074051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:40:12.074051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:40:12.074051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:40:12.074051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:40:12.074051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:40:12.074051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: 471e1e958b29427eb024616ca403985f Jul 12 17:40:12.074051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-TestVolumeBootPattern-1374833581 Jul 12 17:40:12.074051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:40:12.074051 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:40:12.075639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/471e1e958b29427eb024616ca403985f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/471e1e958b29427eb024616ca403985f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/471e1e958b29427eb024616ca403985f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_471e1e958b29427eb024616ca403985f", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:40:12.075639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-TestVolumeBootPattern-1374833581 Jul 12 17:40:12.075639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: 471e1e958b29427eb024616ca403985f Jul 12 17:40:12.075639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-TestVolumeBootPattern-1374833581 Jul 12 17:40:12.075639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-TestVolumeBootPattern-1374833581-project Jul 12 17:40:12.075639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:40:12.075639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:40:12.075639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: 4e066a1d960f48d2ad78d13fc723f54e Jul 12 17:40:12.075639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-TestVolumeBootPattern-1374833581-project Jul 12 17:40:12.075639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:40:12.075639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance 75a152ab-692f-42e7-9c24-a69291f449ae could not be found. Jul 12 17:40:12.075639 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': '75a152ab-692f-42e7-9c24-a69291f449ae'} Jul 12 17:40:12.076793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:40:12.076793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:12.076793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:40:12.076793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:40:12.076793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:40:12.076793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:40:12.076793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:40:12.076793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:40:12.076793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:40:12.076793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:40:12.076793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a152ab-692f-42e7-9c24-a69291f449ae could not be found. Jul 12 17:40:12.076793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:40:12.076793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:40:12.076793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:40:12.076793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:12.076793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:40:12.076793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:40:12.076793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:40:12.076793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:40:12.076793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:40:12.078343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:40:12.078343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:40:12.078343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:40:12.078343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:40:12.078343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:40:12.078343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:40:12.078343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:40:12.078343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a152ab-692f-42e7-9c24-a69291f449ae could not be found. Jul 12 17:40:12.078343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:40:12.078343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:40:12.078343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:40:12.078343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:40:12.078343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:40:12.078343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:40:12.078343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:40:12.078343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:40:12.078343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a152ab-692f-42e7-9c24-a69291f449ae could not be found. Jul 12 17:40:12.078343 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:40:12.079681 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-20924f40-85d9-463f-bcfe-21c274ccb6b6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Returning 404 to user: Instance 75a152ab-692f-42e7-9c24-a69291f449ae could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:40:12.079681 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-20924f40-85d9-463f-bcfe-21c274ccb6b6 tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae" status: 404 len: 111 microversion: 2.1 time: 0.030426 Jul 12 17:40:12.079681 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 600/1235] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:12 2022] GET /compute/v2.1/servers/75a152ab-692f-42e7-9c24-a69291f449ae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:40:12.334530 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-a2311b45-4577-436f-aaab-be3295493085 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:12.335054 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-a2311b45-4577-436f-aaab-be3295493085 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:12.341046 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a2311b45-4577-436f-aaab-be3295493085 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:12.341505 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a2311b45-4577-436f-aaab-be3295493085 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:12.342307 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a2311b45-4577-436f-aaab-be3295493085 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:12.342751 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-a2311b45-4577-436f-aaab-be3295493085 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:12.365972 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-a2311b45-4577-436f-aaab-be3295493085 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909/ips" status: 200 len: 146 microversion: 2.1 time: 0.035825 Jul 12 17:40:12.366581 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 636/1236] 10.222.0.62 () {58 vars in 1247 bytes} [Tue Jul 12 17:40:12 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:40:13.360876 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-788888b6-8862-48f2-8e65-6fb2e435d5ca tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] Calling method '.version_select at 0x7f87299adc10>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:13.379023 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-788888b6-8862-48f2-8e65-6fb2e435d5ca tempest-TestVolumeBootPattern-1374833581 tempest-TestVolumeBootPattern-1374833581-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1098037494" status: 202 len: 0 microversion: 2.1 time: 0.021959 Jul 12 17:40:13.379697 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 601/1237] 10.222.0.62 () {58 vars in 1262 bytes} [Tue Jul 12 17:40:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1098037494 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:40:14.883405 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-77cc3a7f-caaa-4ef7-9ebe-66a373f97196 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "300c8245-fe92-416e-bf87-4e2eb31aad0c"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:40:14.884464 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-77cc3a7f-caaa-4ef7-9ebe-66a373f97196 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:14.890826 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-77cc3a7f-caaa-4ef7-9ebe-66a373f97196 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:14.891273 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-77cc3a7f-caaa-4ef7-9ebe-66a373f97196 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:14.892045 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-77cc3a7f-caaa-4ef7-9ebe-66a373f97196 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:14.892478 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-77cc3a7f-caaa-4ef7-9ebe-66a373f97196 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:15.161140 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-77cc3a7f-caaa-4ef7-9ebe-66a373f97196 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "POST /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281438 Jul 12 17:40:15.162200 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 637/1238] 10.222.0.62 () {60 vars in 1322 bytes} [Tue Jul 12 17:40:14 2022] POST /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:40:22.675582 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:22.680032 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-81d47491-ecc7-4434-9139-cf2b3a6a4b92 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:40:22.690148 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-81d47491-ecc7-4434-9139-cf2b3a6a4b92 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:22.690601 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-81d47491-ecc7-4434-9139-cf2b3a6a4b92 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:22.748706 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-81d47491-ecc7-4434-9139-cf2b3a6a4b92 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Going to try to stop instance {{(pid=117939) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 17:40:22.790502 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-81d47491-ecc7-4434-9139-cf2b3a6a4b92 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "POST /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909/action" status: 202 len: 0 microversion: 2.1 time: 0.115988 Jul 12 17:40:22.791089 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 602/1239] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Jul 12 17:40:22 2022] POST /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:40:22.800797 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-423b0506-b6c8-4319-a122-4d22fa59908f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:22.801488 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-423b0506-b6c8-4319-a122-4d22fa59908f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:22.807841 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-423b0506-b6c8-4319-a122-4d22fa59908f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:22.808301 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-423b0506-b6c8-4319-a122-4d22fa59908f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:22.809431 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-423b0506-b6c8-4319-a122-4d22fa59908f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:22.809898 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-423b0506-b6c8-4319-a122-4d22fa59908f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:22.943965 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-423b0506-b6c8-4319-a122-4d22fa59908f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:22.951863 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-423b0506-b6c8-4319-a122-4d22fa59908f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1725 microversion: 2.1 time: 0.155959 Jul 12 17:40:22.952419 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 638/1240] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:22 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:23.970175 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-01e58411-3a3f-4d85-b1d9-0e6fd68d1e0e tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:23.971423 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-01e58411-3a3f-4d85-b1d9-0e6fd68d1e0e tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:23.977528 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-01e58411-3a3f-4d85-b1d9-0e6fd68d1e0e tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:23.978008 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-01e58411-3a3f-4d85-b1d9-0e6fd68d1e0e tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:23.978805 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-01e58411-3a3f-4d85-b1d9-0e6fd68d1e0e tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:23.979244 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-01e58411-3a3f-4d85-b1d9-0e6fd68d1e0e tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:24.105890 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-01e58411-3a3f-4d85-b1d9-0e6fd68d1e0e tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:24.113711 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-01e58411-3a3f-4d85-b1d9-0e6fd68d1e0e tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1725 microversion: 2.1 time: 0.148371 Jul 12 17:40:24.114268 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 603/1241] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:23 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:25.131837 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-41a750a9-b0e8-414d-9f48-51f250616b86 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:25.132446 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-41a750a9-b0e8-414d-9f48-51f250616b86 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:25.138845 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41a750a9-b0e8-414d-9f48-51f250616b86 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:25.139290 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41a750a9-b0e8-414d-9f48-51f250616b86 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:25.140035 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41a750a9-b0e8-414d-9f48-51f250616b86 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:25.140464 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-41a750a9-b0e8-414d-9f48-51f250616b86 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:25.265235 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-41a750a9-b0e8-414d-9f48-51f250616b86 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:25.273026 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-41a750a9-b0e8-414d-9f48-51f250616b86 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1725 microversion: 2.1 time: 0.145746 Jul 12 17:40:25.273616 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 639/1242] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:25 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:26.289894 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1aeb7f42-169b-4850-b241-dd20f3944a51 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:26.290547 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1aeb7f42-169b-4850-b241-dd20f3944a51 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:26.297113 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1aeb7f42-169b-4850-b241-dd20f3944a51 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:26.297561 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1aeb7f42-169b-4850-b241-dd20f3944a51 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:26.298362 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1aeb7f42-169b-4850-b241-dd20f3944a51 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:26.299289 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1aeb7f42-169b-4850-b241-dd20f3944a51 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:26.428019 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1aeb7f42-169b-4850-b241-dd20f3944a51 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:26.436058 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1aeb7f42-169b-4850-b241-dd20f3944a51 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1725 microversion: 2.1 time: 0.150062 Jul 12 17:40:26.436622 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 604/1243] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:26 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:27.453578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-118ebf26-0dde-4b40-a3f8-2b7abbf5b957 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:27.454225 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-118ebf26-0dde-4b40-a3f8-2b7abbf5b957 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:27.461204 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-118ebf26-0dde-4b40-a3f8-2b7abbf5b957 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:27.461655 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-118ebf26-0dde-4b40-a3f8-2b7abbf5b957 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:27.462440 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-118ebf26-0dde-4b40-a3f8-2b7abbf5b957 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:27.462873 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-118ebf26-0dde-4b40-a3f8-2b7abbf5b957 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:27.590052 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-118ebf26-0dde-4b40-a3f8-2b7abbf5b957 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:27.597908 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-118ebf26-0dde-4b40-a3f8-2b7abbf5b957 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1725 microversion: 2.1 time: 0.148213 Jul 12 17:40:27.598478 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 640/1244] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:27 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:28.615048 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e2252333-88a9-4902-9825-e038b9930da1 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:28.615660 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e2252333-88a9-4902-9825-e038b9930da1 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:28.622274 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e2252333-88a9-4902-9825-e038b9930da1 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:28.622791 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e2252333-88a9-4902-9825-e038b9930da1 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:28.623510 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e2252333-88a9-4902-9825-e038b9930da1 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:28.623944 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e2252333-88a9-4902-9825-e038b9930da1 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:28.755380 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-e2252333-88a9-4902-9825-e038b9930da1 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:28.763303 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e2252333-88a9-4902-9825-e038b9930da1 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1725 microversion: 2.1 time: 0.152188 Jul 12 17:40:28.763864 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 605/1245] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:28 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:29.780858 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-50e7ae00-c92a-40ea-a25a-a4db71ab9926 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:29.781509 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-50e7ae00-c92a-40ea-a25a-a4db71ab9926 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:29.788487 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-50e7ae00-c92a-40ea-a25a-a4db71ab9926 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:29.788940 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-50e7ae00-c92a-40ea-a25a-a4db71ab9926 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:29.789720 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-50e7ae00-c92a-40ea-a25a-a4db71ab9926 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:29.790163 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-50e7ae00-c92a-40ea-a25a-a4db71ab9926 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:29.915254 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-50e7ae00-c92a-40ea-a25a-a4db71ab9926 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:29.923106 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-50e7ae00-c92a-40ea-a25a-a4db71ab9926 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1725 microversion: 2.1 time: 0.146193 Jul 12 17:40:29.924281 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 641/1246] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:29 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:40:30.941062 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8f7845c6-ebd4-4414-b2cc-de969e24785a tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:30.941759 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8f7845c6-ebd4-4414-b2cc-de969e24785a tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:30.948159 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8f7845c6-ebd4-4414-b2cc-de969e24785a tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:30.948563 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8f7845c6-ebd4-4414-b2cc-de969e24785a tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:30.949297 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8f7845c6-ebd4-4414-b2cc-de969e24785a tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:30.949753 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8f7845c6-ebd4-4414-b2cc-de969e24785a tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:31.080148 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8f7845c6-ebd4-4414-b2cc-de969e24785a tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:31.087628 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8f7845c6-ebd4-4414-b2cc-de969e24785a tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1725 microversion: 2.1 time: 0.150996 Jul 12 17:40:31.088186 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 606/1247] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:30 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:32.104740 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-99a323fc-291d-4013-9526-6225cef8272b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:32.105390 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-99a323fc-291d-4013-9526-6225cef8272b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:32.111821 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-99a323fc-291d-4013-9526-6225cef8272b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:32.112277 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-99a323fc-291d-4013-9526-6225cef8272b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:32.113035 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-99a323fc-291d-4013-9526-6225cef8272b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:32.113476 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-99a323fc-291d-4013-9526-6225cef8272b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:32.117657 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:32.244968 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-99a323fc-291d-4013-9526-6225cef8272b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:32.253388 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-99a323fc-291d-4013-9526-6225cef8272b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1725 microversion: 2.1 time: 0.152570 Jul 12 17:40:32.253983 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 642/1248] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:32 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:33.271245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-9d3bd3c2-b653-47c4-9173-fd83ddade21b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:33.272099 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-9d3bd3c2-b653-47c4-9173-fd83ddade21b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:33.274265 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:33.279667 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9d3bd3c2-b653-47c4-9173-fd83ddade21b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:33.280112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9d3bd3c2-b653-47c4-9173-fd83ddade21b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:33.280871 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9d3bd3c2-b653-47c4-9173-fd83ddade21b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:33.281301 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-9d3bd3c2-b653-47c4-9173-fd83ddade21b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:33.406865 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-9d3bd3c2-b653-47c4-9173-fd83ddade21b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:33.415238 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-9d3bd3c2-b653-47c4-9173-fd83ddade21b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1702 microversion: 2.1 time: 0.148523 Jul 12 17:40:33.415797 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 607/1249] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:33 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1702 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:33.431330 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f316f1a0-ab1e-4472-9376-b7c92732901b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:40:33.434024 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:40:33.439719 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f316f1a0-ab1e-4472-9376-b7c92732901b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:33.440205 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f316f1a0-ab1e-4472-9376-b7c92732901b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:33.498522 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f316f1a0-ab1e-4472-9376-b7c92732901b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Going to try to start instance {{(pid=117938) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 17:40:33.539357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f316f1a0-ab1e-4472-9376-b7c92732901b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "POST /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909/action" status: 202 len: 0 microversion: 2.1 time: 0.111699 Jul 12 17:40:33.539941 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 643/1250] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Jul 12 17:40:33 2022] POST /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:40:33.548043 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-bc8f1f38-8b7b-468c-b34e-5ca0bbf248a2 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:33.548705 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-bc8f1f38-8b7b-468c-b34e-5ca0bbf248a2 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:33.554832 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bc8f1f38-8b7b-468c-b34e-5ca0bbf248a2 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:33.555274 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bc8f1f38-8b7b-468c-b34e-5ca0bbf248a2 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:33.556159 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bc8f1f38-8b7b-468c-b34e-5ca0bbf248a2 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:33.556595 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bc8f1f38-8b7b-468c-b34e-5ca0bbf248a2 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:33.720392 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-bc8f1f38-8b7b-468c-b34e-5ca0bbf248a2 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:33.728367 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-bc8f1f38-8b7b-468c-b34e-5ca0bbf248a2 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1711 microversion: 2.1 time: 0.184116 Jul 12 17:40:33.728937 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 608/1251] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:33 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1711 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:34.746529 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-ba382d2f-00d9-4685-ba80-e1a1f51fd078 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:34.747259 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-ba382d2f-00d9-4685-ba80-e1a1f51fd078 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:34.753439 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ba382d2f-00d9-4685-ba80-e1a1f51fd078 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:34.753933 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ba382d2f-00d9-4685-ba80-e1a1f51fd078 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:34.754701 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ba382d2f-00d9-4685-ba80-e1a1f51fd078 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:34.755133 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-ba382d2f-00d9-4685-ba80-e1a1f51fd078 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:34.886967 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-ba382d2f-00d9-4685-ba80-e1a1f51fd078 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:34.895245 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-ba382d2f-00d9-4685-ba80-e1a1f51fd078 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1711 microversion: 2.1 time: 0.153456 Jul 12 17:40:34.895812 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 644/1252] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:34 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1711 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:40:35.912718 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1742fbbf-e409-4fa4-96dd-f31e2539b892 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:40:35.913330 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-1742fbbf-e409-4fa4-96dd-f31e2539b892 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:40:35.919940 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1742fbbf-e409-4fa4-96dd-f31e2539b892 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:35.920388 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1742fbbf-e409-4fa4-96dd-f31e2539b892 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:35.921147 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1742fbbf-e409-4fa4-96dd-f31e2539b892 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:40:35.921583 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-1742fbbf-e409-4fa4-96dd-f31e2539b892 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:40:36.050405 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-1742fbbf-e409-4fa4-96dd-f31e2539b892 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:40:36.058212 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1742fbbf-e409-4fa4-96dd-f31e2539b892 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1715 microversion: 2.1 time: 0.149401 Jul 12 17:40:36.059036 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 609/1253] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:40:35 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:05.655039 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:41:05.655578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Tue Jul 12 17:41:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:41:06.343949 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:41:06.344217 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Tue Jul 12 17:41:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:41:39.183732 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=3 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:39.184504 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:39.188530 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c7f78810-85b5-4872-9727-fbfe5a08e9d4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:39.189024 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c7f78810-85b5-4872-9727-fbfe5a08e9d4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:39.195937 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c7f78810-85b5-4872-9727-fbfe5a08e9d4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:39.196384 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c7f78810-85b5-4872-9727-fbfe5a08e9d4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:39.197136 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c7f78810-85b5-4872-9727-fbfe5a08e9d4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:39.197572 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c7f78810-85b5-4872-9727-fbfe5a08e9d4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:39.471589 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-c7f78810-85b5-4872-9727-fbfe5a08e9d4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lazy-loading 'services' on Instance uuid 0eadcdea-7baa-4f12-a2c8-7a6506824909 {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:41:39.540551 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c7f78810-85b5-4872-9727-fbfe5a08e9d4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909/os-volume_attachments/300c8245-fe92-416e-bf87-4e2eb31aad0c" status: 202 len: 0 microversion: 2.1 time: 0.358540 Jul 12 17:41:39.541350 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 645/1254] 10.222.0.62 () {58 vars in 1415 bytes} [Tue Jul 12 17:41:39 2022] DELETE /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909/os-volume_attachments/300c8245-fe92-416e-bf87-4e2eb31aad0c => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:41:40.650287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=5 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:40.651113 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:40.655234 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7047446f-a76d-445b-bdf4-c005660fd81a tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:41:40.662352 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7047446f-a76d-445b-bdf4-c005660fd81a tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:40.662803 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7047446f-a76d-445b-bdf4-c005660fd81a tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:40.685537 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7047446f-a76d-445b-bdf4-c005660fd81a tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Going to try to stop instance {{(pid=117939) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 17:41:40.726111 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7047446f-a76d-445b-bdf4-c005660fd81a tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "POST /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909/action" status: 202 len: 0 microversion: 2.1 time: 0.077200 Jul 12 17:41:40.726627 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 610/1255] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Jul 12 17:41:40 2022] POST /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:41:40.735361 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1d99f5b3-4c76-4f2c-bd40-ba1e40071ebe tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:40.736075 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1d99f5b3-4c76-4f2c-bd40-ba1e40071ebe tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:40.744304 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1d99f5b3-4c76-4f2c-bd40-ba1e40071ebe tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:40.745331 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1d99f5b3-4c76-4f2c-bd40-ba1e40071ebe tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:40.746141 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1d99f5b3-4c76-4f2c-bd40-ba1e40071ebe tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:40.746573 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1d99f5b3-4c76-4f2c-bd40-ba1e40071ebe tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:40.878108 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1d99f5b3-4c76-4f2c-bd40-ba1e40071ebe tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:40.885430 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1d99f5b3-4c76-4f2c-bd40-ba1e40071ebe tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1679 microversion: 2.1 time: 0.154243 Jul 12 17:41:40.886030 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 646/1256] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:40 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:41.903284 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-446bd17d-66f8-4f31-bce8-ce6925dec875 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:41.903985 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-446bd17d-66f8-4f31-bce8-ce6925dec875 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:41.910618 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-446bd17d-66f8-4f31-bce8-ce6925dec875 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:41.911065 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-446bd17d-66f8-4f31-bce8-ce6925dec875 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:41.911833 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-446bd17d-66f8-4f31-bce8-ce6925dec875 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:41.912264 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-446bd17d-66f8-4f31-bce8-ce6925dec875 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:42.143857 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-446bd17d-66f8-4f31-bce8-ce6925dec875 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:42.151243 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-446bd17d-66f8-4f31-bce8-ce6925dec875 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1679 microversion: 2.1 time: 0.252225 Jul 12 17:41:42.151797 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 611/1257] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:41 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1679 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:41:43.168351 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-37e398ea-c586-4b8d-bf02-70496d9c66d0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:43.168962 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-37e398ea-c586-4b8d-bf02-70496d9c66d0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:43.175421 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37e398ea-c586-4b8d-bf02-70496d9c66d0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:43.175870 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37e398ea-c586-4b8d-bf02-70496d9c66d0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:43.176620 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37e398ea-c586-4b8d-bf02-70496d9c66d0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:43.177050 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-37e398ea-c586-4b8d-bf02-70496d9c66d0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:43.302125 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-37e398ea-c586-4b8d-bf02-70496d9c66d0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:43.309672 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-37e398ea-c586-4b8d-bf02-70496d9c66d0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1679 microversion: 2.1 time: 0.145239 Jul 12 17:41:43.310253 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 647/1258] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:43 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1679 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:44.326991 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-53889a00-b30f-484d-920e-39364ee05560 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:44.327606 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-53889a00-b30f-484d-920e-39364ee05560 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:44.334089 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-53889a00-b30f-484d-920e-39364ee05560 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:44.334540 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-53889a00-b30f-484d-920e-39364ee05560 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:44.335307 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-53889a00-b30f-484d-920e-39364ee05560 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:44.335743 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-53889a00-b30f-484d-920e-39364ee05560 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:44.460974 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-53889a00-b30f-484d-920e-39364ee05560 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:44.468429 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-53889a00-b30f-484d-920e-39364ee05560 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1679 microversion: 2.1 time: 0.145339 Jul 12 17:41:44.468990 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 612/1259] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:44 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1679 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:45.485333 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-25d65589-b14c-4534-9036-a6c9f4d13fd5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:45.485917 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-25d65589-b14c-4534-9036-a6c9f4d13fd5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:45.492381 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-25d65589-b14c-4534-9036-a6c9f4d13fd5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:45.492830 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-25d65589-b14c-4534-9036-a6c9f4d13fd5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:45.493589 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-25d65589-b14c-4534-9036-a6c9f4d13fd5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:45.494052 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-25d65589-b14c-4534-9036-a6c9f4d13fd5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:45.621251 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-25d65589-b14c-4534-9036-a6c9f4d13fd5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:45.629059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-25d65589-b14c-4534-9036-a6c9f4d13fd5 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1679 microversion: 2.1 time: 0.147623 Jul 12 17:41:45.630133 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 648/1260] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:45 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:46.646880 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ac5ecf38-2de1-49a9-b8e1-cee766aef3e7 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:46.647488 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ac5ecf38-2de1-49a9-b8e1-cee766aef3e7 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:46.653867 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ac5ecf38-2de1-49a9-b8e1-cee766aef3e7 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:46.654313 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ac5ecf38-2de1-49a9-b8e1-cee766aef3e7 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:46.655065 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ac5ecf38-2de1-49a9-b8e1-cee766aef3e7 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:46.655495 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ac5ecf38-2de1-49a9-b8e1-cee766aef3e7 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:46.783176 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ac5ecf38-2de1-49a9-b8e1-cee766aef3e7 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:46.791037 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ac5ecf38-2de1-49a9-b8e1-cee766aef3e7 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1679 microversion: 2.1 time: 0.148510 Jul 12 17:41:46.791593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 613/1261] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:46 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:41:47.808873 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-86c79fc0-4b64-4350-8b2f-ca181bba025c tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:47.809491 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-86c79fc0-4b64-4350-8b2f-ca181bba025c tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:47.815999 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-86c79fc0-4b64-4350-8b2f-ca181bba025c tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:47.816450 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-86c79fc0-4b64-4350-8b2f-ca181bba025c tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:47.817213 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-86c79fc0-4b64-4350-8b2f-ca181bba025c tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:47.817655 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-86c79fc0-4b64-4350-8b2f-ca181bba025c tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:47.946864 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-86c79fc0-4b64-4350-8b2f-ca181bba025c tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:47.954325 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-86c79fc0-4b64-4350-8b2f-ca181bba025c tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1679 microversion: 2.1 time: 0.149668 Jul 12 17:41:47.954898 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 649/1262] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:47 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:48.971896 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-52b93a40-2079-46cc-815d-b69ad3a5643c tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:48.972487 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-52b93a40-2079-46cc-815d-b69ad3a5643c tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:48.978922 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-52b93a40-2079-46cc-815d-b69ad3a5643c tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:48.979370 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-52b93a40-2079-46cc-815d-b69ad3a5643c tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:48.980130 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-52b93a40-2079-46cc-815d-b69ad3a5643c tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:48.980564 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-52b93a40-2079-46cc-815d-b69ad3a5643c tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:49.104698 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-52b93a40-2079-46cc-815d-b69ad3a5643c tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:49.111995 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-52b93a40-2079-46cc-815d-b69ad3a5643c tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1679 microversion: 2.1 time: 0.144009 Jul 12 17:41:49.112553 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 614/1263] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:48 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1679 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:50.130056 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-798f2e0e-9aef-4907-9d75-994ec71b46e0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:50.130679 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-798f2e0e-9aef-4907-9d75-994ec71b46e0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:50.137279 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-798f2e0e-9aef-4907-9d75-994ec71b46e0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:50.137768 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-798f2e0e-9aef-4907-9d75-994ec71b46e0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:50.138532 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-798f2e0e-9aef-4907-9d75-994ec71b46e0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:50.138971 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-798f2e0e-9aef-4907-9d75-994ec71b46e0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:50.266069 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-798f2e0e-9aef-4907-9d75-994ec71b46e0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:50.273438 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-798f2e0e-9aef-4907-9d75-994ec71b46e0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1679 microversion: 2.1 time: 0.147811 Jul 12 17:41:50.274036 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 650/1264] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:50 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:41:51.290641 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ed78f3ea-e06d-441b-92d6-e1e8d6f3f747 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:51.291253 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ed78f3ea-e06d-441b-92d6-e1e8d6f3f747 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:51.297771 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ed78f3ea-e06d-441b-92d6-e1e8d6f3f747 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:51.298224 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ed78f3ea-e06d-441b-92d6-e1e8d6f3f747 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:51.299019 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ed78f3ea-e06d-441b-92d6-e1e8d6f3f747 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:51.299453 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ed78f3ea-e06d-441b-92d6-e1e8d6f3f747 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:51.425593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-ed78f3ea-e06d-441b-92d6-e1e8d6f3f747 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:51.433224 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ed78f3ea-e06d-441b-92d6-e1e8d6f3f747 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1679 microversion: 2.1 time: 0.146447 Jul 12 17:41:51.433800 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 615/1265] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:51 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:52.450602 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1f2a2e40-24bf-42ec-8489-ab197f9aa5eb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:52.451215 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-1f2a2e40-24bf-42ec-8489-ab197f9aa5eb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:52.458222 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1f2a2e40-24bf-42ec-8489-ab197f9aa5eb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:52.458669 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1f2a2e40-24bf-42ec-8489-ab197f9aa5eb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:52.459427 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1f2a2e40-24bf-42ec-8489-ab197f9aa5eb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:52.459858 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-1f2a2e40-24bf-42ec-8489-ab197f9aa5eb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:52.584562 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-1f2a2e40-24bf-42ec-8489-ab197f9aa5eb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:52.591948 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1f2a2e40-24bf-42ec-8489-ab197f9aa5eb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1679 microversion: 2.1 time: 0.145279 Jul 12 17:41:52.592507 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 651/1266] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:52 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1679 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:53.609619 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-a0fde88f-9f27-4c7c-a905-0878c9bd3b83 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:53.610472 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-a0fde88f-9f27-4c7c-a905-0878c9bd3b83 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:53.617733 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a0fde88f-9f27-4c7c-a905-0878c9bd3b83 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:53.618187 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a0fde88f-9f27-4c7c-a905-0878c9bd3b83 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:53.618951 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a0fde88f-9f27-4c7c-a905-0878c9bd3b83 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:53.619382 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-a0fde88f-9f27-4c7c-a905-0878c9bd3b83 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:53.748795 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-a0fde88f-9f27-4c7c-a905-0878c9bd3b83 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:53.756245 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-a0fde88f-9f27-4c7c-a905-0878c9bd3b83 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1679 microversion: 2.1 time: 0.150504 Jul 12 17:41:53.756806 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 616/1267] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:53 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 17:41:54.773131 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-43dad333-b7af-40e8-891e-9c39e3ef001b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:54.773770 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-43dad333-b7af-40e8-891e-9c39e3ef001b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:54.780092 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-43dad333-b7af-40e8-891e-9c39e3ef001b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:54.780543 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-43dad333-b7af-40e8-891e-9c39e3ef001b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:54.781334 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-43dad333-b7af-40e8-891e-9c39e3ef001b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:54.781810 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-43dad333-b7af-40e8-891e-9c39e3ef001b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:54.906205 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-43dad333-b7af-40e8-891e-9c39e3ef001b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:54.913604 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-43dad333-b7af-40e8-891e-9c39e3ef001b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1679 microversion: 2.1 time: 0.144397 Jul 12 17:41:54.914193 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 652/1268] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:54 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1679 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:55.930992 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-aab2d3dd-e54f-4ba4-ad17-38bf9439468d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:55.931638 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-aab2d3dd-e54f-4ba4-ad17-38bf9439468d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:55.938353 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aab2d3dd-e54f-4ba4-ad17-38bf9439468d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:55.938797 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aab2d3dd-e54f-4ba4-ad17-38bf9439468d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:55.939586 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aab2d3dd-e54f-4ba4-ad17-38bf9439468d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:55.940023 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-aab2d3dd-e54f-4ba4-ad17-38bf9439468d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:56.066349 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-aab2d3dd-e54f-4ba4-ad17-38bf9439468d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:56.074418 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-aab2d3dd-e54f-4ba4-ad17-38bf9439468d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1679 microversion: 2.1 time: 0.147320 Jul 12 17:41:56.074977 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 617/1269] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:55 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:57.091206 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-05f9bb03-6981-4ca0-b76b-b266a6bb1a21 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:57.091819 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-05f9bb03-6981-4ca0-b76b-b266a6bb1a21 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:57.098249 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-05f9bb03-6981-4ca0-b76b-b266a6bb1a21 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:57.098719 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-05f9bb03-6981-4ca0-b76b-b266a6bb1a21 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:57.099493 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-05f9bb03-6981-4ca0-b76b-b266a6bb1a21 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:57.099933 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-05f9bb03-6981-4ca0-b76b-b266a6bb1a21 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:57.224953 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-05f9bb03-6981-4ca0-b76b-b266a6bb1a21 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:57.232368 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-05f9bb03-6981-4ca0-b76b-b266a6bb1a21 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1679 microversion: 2.1 time: 0.145061 Jul 12 17:41:57.232928 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 653/1270] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:57 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1679 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:58.249823 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-8dea3696-640d-472d-8c97-3a419d6e8959 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:58.250463 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-8dea3696-640d-472d-8c97-3a419d6e8959 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:58.257255 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8dea3696-640d-472d-8c97-3a419d6e8959 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:58.257721 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8dea3696-640d-472d-8c97-3a419d6e8959 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:58.258469 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8dea3696-640d-472d-8c97-3a419d6e8959 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:58.258900 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-8dea3696-640d-472d-8c97-3a419d6e8959 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:58.383775 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-8dea3696-640d-472d-8c97-3a419d6e8959 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:58.391112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-8dea3696-640d-472d-8c97-3a419d6e8959 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1679 microversion: 2.1 time: 0.145159 Jul 12 17:41:58.391671 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 618/1271] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:58 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1679 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:41:59.406912 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-9dd6fe6c-b4f4-4830-af7a-93ab2093c732 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:41:59.407518 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-9dd6fe6c-b4f4-4830-af7a-93ab2093c732 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:41:59.413935 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9dd6fe6c-b4f4-4830-af7a-93ab2093c732 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:59.414383 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9dd6fe6c-b4f4-4830-af7a-93ab2093c732 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:59.415128 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9dd6fe6c-b4f4-4830-af7a-93ab2093c732 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:41:59.415558 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-9dd6fe6c-b4f4-4830-af7a-93ab2093c732 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:41:59.785366 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-9dd6fe6c-b4f4-4830-af7a-93ab2093c732 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:41:59.792861 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-9dd6fe6c-b4f4-4830-af7a-93ab2093c732 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1679 microversion: 2.1 time: 0.389781 Jul 12 17:41:59.793420 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 654/1272] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:41:59 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1679 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:00.810087 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0d7caa5d-b3de-4332-bb1e-7a7de885d1fc tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:00.810731 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0d7caa5d-b3de-4332-bb1e-7a7de885d1fc tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:00.817142 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0d7caa5d-b3de-4332-bb1e-7a7de885d1fc tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:00.817588 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0d7caa5d-b3de-4332-bb1e-7a7de885d1fc tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:00.818380 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0d7caa5d-b3de-4332-bb1e-7a7de885d1fc tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:00.818816 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0d7caa5d-b3de-4332-bb1e-7a7de885d1fc tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:00.944714 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0d7caa5d-b3de-4332-bb1e-7a7de885d1fc tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:00.952266 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0d7caa5d-b3de-4332-bb1e-7a7de885d1fc tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1679 microversion: 2.1 time: 0.146374 Jul 12 17:42:00.952827 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 619/1273] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:00 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:01.969834 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-8be30966-440e-4ad6-b59d-7d5f918a1a65 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:01.970446 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-8be30966-440e-4ad6-b59d-7d5f918a1a65 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:01.977491 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8be30966-440e-4ad6-b59d-7d5f918a1a65 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:01.977957 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8be30966-440e-4ad6-b59d-7d5f918a1a65 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:01.978713 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8be30966-440e-4ad6-b59d-7d5f918a1a65 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:01.979146 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-8be30966-440e-4ad6-b59d-7d5f918a1a65 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:02.106100 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-8be30966-440e-4ad6-b59d-7d5f918a1a65 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:02.113483 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-8be30966-440e-4ad6-b59d-7d5f918a1a65 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1656 microversion: 2.1 time: 0.147595 Jul 12 17:42:02.114083 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 655/1274] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:01 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1656 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:02.130230 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-e9dc2a24-5ed6-4cc1-9b46-034cf2a737a7 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:42:02.136754 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e9dc2a24-5ed6-4cc1-9b46-034cf2a737a7 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:02.137196 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-e9dc2a24-5ed6-4cc1-9b46-034cf2a737a7 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:02.160434 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-e9dc2a24-5ed6-4cc1-9b46-034cf2a737a7 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Going to try to start instance {{(pid=117939) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 17:42:02.202428 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-e9dc2a24-5ed6-4cc1-9b46-034cf2a737a7 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "POST /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909/action" status: 202 len: 0 microversion: 2.1 time: 0.075956 Jul 12 17:42:02.203000 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 620/1275] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Jul 12 17:42:02 2022] POST /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:42:02.211818 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-0c1f41e8-3f88-48e0-9445-af5daafec519 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:02.212435 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-0c1f41e8-3f88-48e0-9445-af5daafec519 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:02.219031 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0c1f41e8-3f88-48e0-9445-af5daafec519 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:02.219614 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0c1f41e8-3f88-48e0-9445-af5daafec519 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:02.220387 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0c1f41e8-3f88-48e0-9445-af5daafec519 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:02.220876 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-0c1f41e8-3f88-48e0-9445-af5daafec519 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:02.354404 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-0c1f41e8-3f88-48e0-9445-af5daafec519 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:02.361850 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-0c1f41e8-3f88-48e0-9445-af5daafec519 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1665 microversion: 2.1 time: 0.154488 Jul 12 17:42:02.362391 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 656/1276] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:02 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:03.381081 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-998b71e4-7ff9-4e25-a63a-8aa4df387020 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:03.381808 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-998b71e4-7ff9-4e25-a63a-8aa4df387020 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:03.387983 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-998b71e4-7ff9-4e25-a63a-8aa4df387020 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:03.388429 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-998b71e4-7ff9-4e25-a63a-8aa4df387020 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:03.389194 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-998b71e4-7ff9-4e25-a63a-8aa4df387020 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:03.389628 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-998b71e4-7ff9-4e25-a63a-8aa4df387020 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:03.524174 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-998b71e4-7ff9-4e25-a63a-8aa4df387020 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:03.531591 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-998b71e4-7ff9-4e25-a63a-8aa4df387020 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1665 microversion: 2.1 time: 0.155773 Jul 12 17:42:03.532156 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 621/1277] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:03 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:04.549316 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-53f80c6b-15c5-4bb1-8ea5-f114f8ade55b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:04.550008 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-53f80c6b-15c5-4bb1-8ea5-f114f8ade55b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:04.556526 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53f80c6b-15c5-4bb1-8ea5-f114f8ade55b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:04.557234 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53f80c6b-15c5-4bb1-8ea5-f114f8ade55b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:04.558031 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53f80c6b-15c5-4bb1-8ea5-f114f8ade55b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:04.558470 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-53f80c6b-15c5-4bb1-8ea5-f114f8ade55b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:04.685350 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-53f80c6b-15c5-4bb1-8ea5-f114f8ade55b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:42:04.692851 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-53f80c6b-15c5-4bb1-8ea5-f114f8ade55b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1669 microversion: 2.1 time: 0.147376 Jul 12 17:42:04.693418 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 657/1278] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:42:04 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1669 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:42:48.329283 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:42:48.329895 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Tue Jul 12 17:42:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:42:59.975243 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-5f7aa6ce-bdf0-4e56-a44e-62b045a022b4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:42:59.976246 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-5f7aa6ce-bdf0-4e56-a44e-62b045a022b4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:42:59.978267 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=24 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:59.978923 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:42:59.986011 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5f7aa6ce-bdf0-4e56-a44e-62b045a022b4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:59.986465 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5f7aa6ce-bdf0-4e56-a44e-62b045a022b4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:42:59.987240 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5f7aa6ce-bdf0-4e56-a44e-62b045a022b4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:42:59.987697 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-5f7aa6ce-bdf0-4e56-a44e-62b045a022b4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:00.017174 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-5f7aa6ce-bdf0-4e56-a44e-62b045a022b4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045958 Jul 12 17:43:00.017731 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 622/1279] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:42:59 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 17:43:00.074303 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-497e8613-3150-4c47-a97b-7b0708d23ea0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:00.074807 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-497e8613-3150-4c47-a97b-7b0708d23ea0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:00.077108 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=26 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:43:00.077967 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:43:00.083626 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-497e8613-3150-4c47-a97b-7b0708d23ea0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:00.084076 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-497e8613-3150-4c47-a97b-7b0708d23ea0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:00.084840 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-497e8613-3150-4c47-a97b-7b0708d23ea0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:00.085274 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-497e8613-3150-4c47-a97b-7b0708d23ea0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:00.112453 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-497e8613-3150-4c47-a97b-7b0708d23ea0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Going to try to terminate instance {{(pid=117938) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:43:00.194077 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-497e8613-3150-4c47-a97b-7b0708d23ea0 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 204 len: 0 microversion: 2.1 time: 0.122610 Jul 12 17:43:00.194975 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 658/1280] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:43:00 2022] DELETE /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:43:00.204466 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-0198f866-2db7-407a-9ac6-37660c754826 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:00.205076 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-0198f866-2db7-407a-9ac6-37660c754826 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:00.211044 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0198f866-2db7-407a-9ac6-37660c754826 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:00.211489 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0198f866-2db7-407a-9ac6-37660c754826 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:00.212254 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0198f866-2db7-407a-9ac6-37660c754826 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:00.212687 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-0198f866-2db7-407a-9ac6-37660c754826 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:00.345124 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-0198f866-2db7-407a-9ac6-37660c754826 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:00.353085 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-0198f866-2db7-407a-9ac6-37660c754826 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1675 microversion: 2.1 time: 0.153268 Jul 12 17:43:00.353645 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 623/1281] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:00 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:01.370643 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-458ed2f8-72c2-468f-9817-315cdcd9d284 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:01.371336 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-458ed2f8-72c2-468f-9817-315cdcd9d284 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:01.377803 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-458ed2f8-72c2-468f-9817-315cdcd9d284 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:01.378247 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-458ed2f8-72c2-468f-9817-315cdcd9d284 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:01.378994 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-458ed2f8-72c2-468f-9817-315cdcd9d284 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:01.379422 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-458ed2f8-72c2-468f-9817-315cdcd9d284 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:01.505634 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-458ed2f8-72c2-468f-9817-315cdcd9d284 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:01.512952 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-458ed2f8-72c2-468f-9817-315cdcd9d284 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1675 microversion: 2.1 time: 0.146568 Jul 12 17:43:01.513518 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 659/1282] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:01 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:02.530566 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6e8289df-fc48-415c-a3b7-8b09f0502bcd tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:02.531186 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6e8289df-fc48-415c-a3b7-8b09f0502bcd tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:02.538191 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6e8289df-fc48-415c-a3b7-8b09f0502bcd tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:02.538640 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6e8289df-fc48-415c-a3b7-8b09f0502bcd tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:02.539407 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6e8289df-fc48-415c-a3b7-8b09f0502bcd tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:02.539846 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6e8289df-fc48-415c-a3b7-8b09f0502bcd tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:02.746080 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-6e8289df-fc48-415c-a3b7-8b09f0502bcd tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:02.757831 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6e8289df-fc48-415c-a3b7-8b09f0502bcd tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1675 microversion: 2.1 time: 0.231062 Jul 12 17:43:02.758407 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 624/1283] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:02 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1675 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:03.354150 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-a80bc5a3-ab90-4c45-ac57-f205d1ae0817 req-d2a6b781-1d97-4c2e-a703-c40b0e27a0a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eadcdea-7baa-4f12-a2c8-7a6506824909", "name": "network-vif-deleted", "tag": "e522e7de-744a-4fc0-b4c7-1fe412e3f382"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:03.365046 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-a80bc5a3-ab90-4c45-ac57-f205d1ae0817 req-d2a6b781-1d97-4c2e-a703-c40b0e27a0a3 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:03.365785 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-a80bc5a3-ab90-4c45-ac57-f205d1ae0817 req-d2a6b781-1d97-4c2e-a703-c40b0e27a0a3 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:03.377773 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-a80bc5a3-ab90-4c45-ac57-f205d1ae0817 req-d2a6b781-1d97-4c2e-a703-c40b0e27a0a3 service nova] Creating event network-vif-deleted:e522e7de-744a-4fc0-b4c7-1fe412e3f382 for instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 on hv-cinder-84932 Jul 12 17:43:03.383365 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-a80bc5a3-ab90-4c45-ac57-f205d1ae0817 req-d2a6b781-1d97-4c2e-a703-c40b0e27a0a3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112708 Jul 12 17:43:03.383961 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 660/1284] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:03.774902 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7f1e9fe9-43d2-4a63-9260-c7469ed43fae tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:03.776027 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7f1e9fe9-43d2-4a63-9260-c7469ed43fae tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:03.782342 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f1e9fe9-43d2-4a63-9260-c7469ed43fae tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:03.782788 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f1e9fe9-43d2-4a63-9260-c7469ed43fae tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:03.783588 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f1e9fe9-43d2-4a63-9260-c7469ed43fae tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:03.784054 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f1e9fe9-43d2-4a63-9260-c7469ed43fae tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:03.816451 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f1e9fe9-43d2-4a63-9260-c7469ed43fae tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:03.817206 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f1e9fe9-43d2-4a63-9260-c7469ed43fae tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:03.818241 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.objects.instance [None req-7f1e9fe9-43d2-4a63-9260-c7469ed43fae tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lazy-loading 'fault' on Instance uuid 0eadcdea-7baa-4f12-a2c8-7a6506824909 {{(pid=117939) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:43:03.869665 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-7f1e9fe9-43d2-4a63-9260-c7469ed43fae tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:03.876571 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7f1e9fe9-43d2-4a63-9260-c7469ed43fae tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 200 len: 1328 microversion: 2.1 time: 0.105484 Jul 12 17:43:03.877138 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 625/1285] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:03 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 1328 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:04.895618 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f65777ee-bd53-4dc0-b2c6-e97f03c47081 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:04.896874 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-f65777ee-bd53-4dc0-b2c6-e97f03c47081 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:04.903089 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f65777ee-bd53-4dc0-b2c6-e97f03c47081 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:04.903537 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f65777ee-bd53-4dc0-b2c6-e97f03c47081 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:04.904288 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f65777ee-bd53-4dc0-b2c6-e97f03c47081 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:04.904716 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-f65777ee-bd53-4dc0-b2c6-e97f03c47081 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:04.917619 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-f65777ee-bd53-4dc0-b2c6-e97f03c47081 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] HTTP exception thrown: Instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 could not be found. Jul 12 17:43:04.919282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f65777ee-bd53-4dc0-b2c6-e97f03c47081 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Request method failure captured: Jul 12 17:43:04.919282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 HTTP/1.1 Jul 12 17:43:04.919282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:43:04.919282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:43:04.919282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:43:04.919282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:43:04.919282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:43:04.919282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:43:04.919282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:43:04.919282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:43:04.919282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizbGcjes0vjnKLvtCxFsA7akr1C7xAVYtQHCnKKdzO8EQ0NVqs01tNxiQ6i1TxWkYrutj6zTLJjlrjp6z__h_uU-I_QWYyODeeSGdIHRhi62qo94Kz64h_fsnMSpAwyidUGEfOv01TlMncM2loI8xxw0zwnwLGnIFv6_XOldHMoqsFVA Jul 12 17:43:04.919282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:43:04.919282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:43:04.919282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:43:04.919282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:43:04.919282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:43:04.919282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:43:04.919282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: f5c087dddd214fb881ff86e6ece45195 Jul 12 17:43:04.919282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeTestJSON-832840350 Jul 12 17:43:04.919282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:43:04.919282 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:43:04.921059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f5c087dddd214fb881ff86e6ece45195"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f5c087dddd214fb881ff86e6ece45195"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f5c087dddd214fb881ff86e6ece45195"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f5c087dddd214fb881ff86e6ece45195", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:43:04.921059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeTestJSON-832840350 Jul 12 17:43:04.921059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: f5c087dddd214fb881ff86e6ece45195 Jul 12 17:43:04.921059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeTestJSON-832840350 Jul 12 17:43:04.921059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeTestJSON-832840350-project Jul 12 17:43:04.921059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:43:04.921059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:43:04.921059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: fc1d5c8b5b8a43799e4b191b9b10db48 Jul 12 17:43:04.921059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeTestJSON-832840350-project Jul 12 17:43:04.921059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:43:04.921059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 could not be found. Jul 12 17:43:04.921059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': '0eadcdea-7baa-4f12-a2c8-7a6506824909'} Jul 12 17:43:04.922227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:43:04.922227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:43:04.922227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:43:04.922227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:43:04.922227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:43:04.922227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:43:04.922227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:43:04.922227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:43:04.922227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:43:04.922227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:43:04.922227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 could not be found. Jul 12 17:43:04.922227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:43:04.922227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:43:04.922227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:43:04.922227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:43:04.922227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:43:04.922227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:43:04.922227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:43:04.922227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:43:04.922227 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:43:04.923916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:43:04.923916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:43:04.923916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:43:04.923916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:43:04.923916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:43:04.923916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:43:04.923916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:43:04.923916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 could not be found. Jul 12 17:43:04.923916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:43:04.923916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:43:04.923916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:43:04.923916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:43:04.923916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:43:04.923916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:43:04.923916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:43:04.923916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:43:04.923916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 could not be found. Jul 12 17:43:04.923916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:43:04.925499 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-f65777ee-bd53-4dc0-b2c6-e97f03c47081 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Returning 404 to user: Instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:43:04.925499 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-f65777ee-bd53-4dc0-b2c6-e97f03c47081 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 404 len: 111 microversion: 2.1 time: 0.029720 Jul 12 17:43:04.925499 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 661/1286] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:04 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:43:04.929277 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-1f48a858-2abb-469d-bc8e-151223a9e3b1 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '.version_select at 0x7f872a4360d0>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:04.947204 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-1f48a858-2abb-469d-bc8e-151223a9e3b1 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1952326233" status: 202 len: 0 microversion: 2.1 time: 0.021654 Jul 12 17:43:04.947686 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 626/1287] 10.222.0.62 () {58 vars in 1220 bytes} [Tue Jul 12 17:43:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1952326233 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:43:05.550707 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4c888aad-572f-4b15-b508-9797012b0be1 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Action: 'create', calling method: .version_select at 0x7f8729986670>, body: {"keypair": {"name": "tempest-keypair-1840721702", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgJA580SHZEEBCeMxrcX1xDcZIgjD5gcKyKWCmd4K35mFVudlKRwXbXxR/RS+sDOc6qk8hy8c1i1wTz3AALcKb94gcVvoVHdmuq20amh4TMp+114uN88NUj2GMFl41VXQ=="}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:05.564998 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-4c888aad-572f-4b15-b508-9797012b0be1 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Getting quotas for project f5c087dddd214fb881ff86e6ece45195. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:43:05.568790 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.quota [None req-4c888aad-572f-4b15-b508-9797012b0be1 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Getting quotas for user fc1d5c8b5b8a43799e4b191b9b10db48 and project f5c087dddd214fb881ff86e6ece45195. Resources: {'key_pairs'} {{(pid=117938) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:43:05.593150 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4c888aad-572f-4b15-b508-9797012b0be1 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046294 Jul 12 17:43:05.593790 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 662/1288] 10.222.0.62 () {60 vars in 1158 bytes} [Tue Jul 12 17:43:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:06.803726 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7b4689bf-4ad8-47fb-af02-91bd6cce94cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-958218785", "imageRef": "b19e7830-75c9-4706-bd34-4954ba6b4cc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3d64fbb-59ae-47a7-b843-c4a18e75567c"}], "security_groups": [{"name": "tempest-securitygroup--482288087"}], "key_name": "tempest-keypair-1840721702", "user_data": "}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:06.904902 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.network.neutron [None req-7b4689bf-4ad8-47fb-af02-91bd6cce94cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] validate_networks() for [('b3d64fbb-59ae-47a7-b843-c4a18e75567c', None, None, None, None, None)] {{(pid=117939) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 17:43:07.304660 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-7b4689bf-4ad8-47fb-af02-91bd6cce94cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Flavor limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 17:43:07.305094 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-7b4689bf-4ad8-47fb-af02-91bd6cce94cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Image limits 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 17:43:07.305887 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-7b4689bf-4ad8-47fb-af02-91bd6cce94cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Flavor pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 17:43:07.306487 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-7b4689bf-4ad8-47fb-af02-91bd6cce94cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Image pref 0:0:0 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 17:43:07.307058 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.virt.hardware [None req-7b4689bf-4ad8-47fb-af02-91bd6cce94cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117939) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 17:43:07.315996 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7b4689bf-4ad8-47fb-af02-91bd6cce94cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:07.316685 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7b4689bf-4ad8-47fb-af02-91bd6cce94cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:07.317798 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7b4689bf-4ad8-47fb-af02-91bd6cce94cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:07.318540 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7b4689bf-4ad8-47fb-af02-91bd6cce94cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:07.336461 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-7b4689bf-4ad8-47fb-af02-91bd6cce94cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Getting quotas for project f5c087dddd214fb881ff86e6ece45195. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 17:43:07.340419 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.quota [None req-7b4689bf-4ad8-47fb-af02-91bd6cce94cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Getting quotas for user fc1d5c8b5b8a43799e4b191b9b10db48 and project f5c087dddd214fb881ff86e6ece45195. Resources: {'cores', 'ram', 'instances'} {{(pid=117939) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 17:43:07.351976 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7b4689bf-4ad8-47fb-af02-91bd6cce94cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Going to run 1 instances... {{(pid=117939) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 17:43:07.354287 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7b4689bf-4ad8-47fb-af02-91bd6cce94cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19e7830-75c9-4706-bd34-4954ba6b4cc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117939) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 17:43:07.400604 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7b4689bf-4ad8-47fb-af02-91bd6cce94cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.601970 Jul 12 17:43:07.401250 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 627/1289] 10.222.0.62 () {60 vars in 1146 bytes} [Tue Jul 12 17:43:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 17:43:07.412812 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d6751f48-4cbd-42cd-a094-b5ab21e255bd tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:07.413439 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d6751f48-4cbd-42cd-a094-b5ab21e255bd tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:07.472585 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-d6751f48-4cbd-42cd-a094-b5ab21e255bd tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:07.480565 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d6751f48-4cbd-42cd-a094-b5ab21e255bd tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f" status: 200 len: 1237 microversion: 2.1 time: 0.072954 Jul 12 17:43:07.481679 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 663/1290] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:07 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:08.498379 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-01b164cc-406c-4241-bb4c-464956642840 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:08.498978 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-01b164cc-406c-4241-bb4c-464956642840 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:08.506764 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-01b164cc-406c-4241-bb4c-464956642840 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:08.507375 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-01b164cc-406c-4241-bb4c-464956642840 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:08.508500 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-01b164cc-406c-4241-bb4c-464956642840 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:08.509288 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-01b164cc-406c-4241-bb4c-464956642840 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:08.579827 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-01b164cc-406c-4241-bb4c-464956642840 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:08.588237 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-01b164cc-406c-4241-bb4c-464956642840 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f" status: 200 len: 1307 microversion: 2.1 time: 0.094503 Jul 12 17:43:08.588806 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 628/1291] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:08 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:09.604918 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-10ce4168-f3c5-4bdc-aacd-5c1001e62d84 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:09.605612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-10ce4168-f3c5-4bdc-aacd-5c1001e62d84 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:09.612454 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-10ce4168-f3c5-4bdc-aacd-5c1001e62d84 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:09.612899 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-10ce4168-f3c5-4bdc-aacd-5c1001e62d84 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:09.613653 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-10ce4168-f3c5-4bdc-aacd-5c1001e62d84 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:09.614109 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-10ce4168-f3c5-4bdc-aacd-5c1001e62d84 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:09.823607 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-10ce4168-f3c5-4bdc-aacd-5c1001e62d84 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:09.831017 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-10ce4168-f3c5-4bdc-aacd-5c1001e62d84 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f" status: 200 len: 1362 microversion: 2.1 time: 0.230227 Jul 12 17:43:09.831584 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 664/1292] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:09 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:09.950283 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-ea884e6d-c43e-4f6c-a12d-55c3ba887fb5 req-92168ee9-adc8-4084-85fd-bdd5cbfdb4eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eafefc35-452e-4b7a-a39d-bea2bfd33a1f", "tag": "41322bc8-3eed-473b-9211-8d5e941690f8"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:09.974796 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-ea884e6d-c43e-4f6c-a12d-55c3ba887fb5 req-92168ee9-adc8-4084-85fd-bdd5cbfdb4eb service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:09.975250 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-ea884e6d-c43e-4f6c-a12d-55c3ba887fb5 req-92168ee9-adc8-4084-85fd-bdd5cbfdb4eb service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:09.986904 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-ea884e6d-c43e-4f6c-a12d-55c3ba887fb5 req-92168ee9-adc8-4084-85fd-bdd5cbfdb4eb service nova] Creating event network-changed:41322bc8-3eed-473b-9211-8d5e941690f8 for instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f on hv-cinder-84932 Jul 12 17:43:09.993190 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-ea884e6d-c43e-4f6c-a12d-55c3ba887fb5 req-92168ee9-adc8-4084-85fd-bdd5cbfdb4eb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053152 Jul 12 17:43:09.994082 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 629/1293] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:10.847953 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6d8c1af1-3dda-4ad9-a91c-950438b89c80 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:10.848587 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6d8c1af1-3dda-4ad9-a91c-950438b89c80 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:10.855265 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6d8c1af1-3dda-4ad9-a91c-950438b89c80 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:10.855653 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6d8c1af1-3dda-4ad9-a91c-950438b89c80 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:10.856410 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6d8c1af1-3dda-4ad9-a91c-950438b89c80 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:10.856842 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6d8c1af1-3dda-4ad9-a91c-950438b89c80 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:10.980799 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-6d8c1af1-3dda-4ad9-a91c-950438b89c80 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:10.988137 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6d8c1af1-3dda-4ad9-a91c-950438b89c80 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f" status: 200 len: 1362 microversion: 2.1 time: 0.144146 Jul 12 17:43:10.988701 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 665/1294] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:10 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:12.005975 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-4b01e176-9240-4c26-8f11-2dfe78be78bb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:12.006684 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-4b01e176-9240-4c26-8f11-2dfe78be78bb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:12.012823 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4b01e176-9240-4c26-8f11-2dfe78be78bb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:12.013267 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4b01e176-9240-4c26-8f11-2dfe78be78bb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:12.014082 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4b01e176-9240-4c26-8f11-2dfe78be78bb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:12.014606 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-4b01e176-9240-4c26-8f11-2dfe78be78bb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:12.142299 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-4b01e176-9240-4c26-8f11-2dfe78be78bb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:12.150057 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-4b01e176-9240-4c26-8f11-2dfe78be78bb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f" status: 200 len: 1362 microversion: 2.1 time: 0.148794 Jul 12 17:43:12.150617 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 630/1295] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:11 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:13.166662 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-816ec3cc-d61e-480f-a7cb-4ab7cbbcbac4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:13.167231 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-816ec3cc-d61e-480f-a7cb-4ab7cbbcbac4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:13.173524 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-816ec3cc-d61e-480f-a7cb-4ab7cbbcbac4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:13.174129 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-816ec3cc-d61e-480f-a7cb-4ab7cbbcbac4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:13.174891 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-816ec3cc-d61e-480f-a7cb-4ab7cbbcbac4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:13.175320 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-816ec3cc-d61e-480f-a7cb-4ab7cbbcbac4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:13.350425 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-816ec3cc-d61e-480f-a7cb-4ab7cbbcbac4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:13.357764 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-816ec3cc-d61e-480f-a7cb-4ab7cbbcbac4 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f" status: 200 len: 1362 microversion: 2.1 time: 0.194968 Jul 12 17:43:13.358334 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 666/1296] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:13 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:14.374452 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-814cbd58-935b-4e40-83ca-430bed87bb6f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:14.375065 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-814cbd58-935b-4e40-83ca-430bed87bb6f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:14.382160 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-814cbd58-935b-4e40-83ca-430bed87bb6f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:14.382613 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-814cbd58-935b-4e40-83ca-430bed87bb6f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:14.383382 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-814cbd58-935b-4e40-83ca-430bed87bb6f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:14.383821 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-814cbd58-935b-4e40-83ca-430bed87bb6f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:14.508242 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-814cbd58-935b-4e40-83ca-430bed87bb6f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:14.515543 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-814cbd58-935b-4e40-83ca-430bed87bb6f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f" status: 200 len: 1362 microversion: 2.1 time: 0.144924 Jul 12 17:43:14.516105 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 631/1297] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:14 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:15.532145 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-735b392c-d827-4b01-8cf5-1119993f186f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:15.532906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-735b392c-d827-4b01-8cf5-1119993f186f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:15.539400 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-735b392c-d827-4b01-8cf5-1119993f186f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:15.539850 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-735b392c-d827-4b01-8cf5-1119993f186f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:15.540616 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-735b392c-d827-4b01-8cf5-1119993f186f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:15.541055 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-735b392c-d827-4b01-8cf5-1119993f186f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:15.678772 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-735b392c-d827-4b01-8cf5-1119993f186f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:15.686337 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-735b392c-d827-4b01-8cf5-1119993f186f tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f" status: 200 len: 1362 microversion: 2.1 time: 0.158135 Jul 12 17:43:15.686893 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 667/1298] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:15 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:16.703538 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-c6119dd2-0726-4b02-a86a-8b8cfd190afd tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:16.704183 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-c6119dd2-0726-4b02-a86a-8b8cfd190afd tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:16.711685 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c6119dd2-0726-4b02-a86a-8b8cfd190afd tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:16.712139 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c6119dd2-0726-4b02-a86a-8b8cfd190afd tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:16.712913 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c6119dd2-0726-4b02-a86a-8b8cfd190afd tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:16.713352 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-c6119dd2-0726-4b02-a86a-8b8cfd190afd tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:16.842585 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-c6119dd2-0726-4b02-a86a-8b8cfd190afd tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:16.850077 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-c6119dd2-0726-4b02-a86a-8b8cfd190afd tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f" status: 200 len: 1362 microversion: 2.1 time: 0.150707 Jul 12 17:43:16.850692 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 632/1299] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:16 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:16.940818 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-1c8ce07a-b322-4e78-ab03-420bedd9902d req-3f441c0a-4646-4b2d-9d22-d3b88ae38004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eafefc35-452e-4b7a-a39d-bea2bfd33a1f", "name": "network-vif-plugged", "status": "completed", "tag": "41322bc8-3eed-473b-9211-8d5e941690f8"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:16.949272 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-1c8ce07a-b322-4e78-ab03-420bedd9902d req-3f441c0a-4646-4b2d-9d22-d3b88ae38004 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:16.949736 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-1c8ce07a-b322-4e78-ab03-420bedd9902d req-3f441c0a-4646-4b2d-9d22-d3b88ae38004 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:16.960891 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-1c8ce07a-b322-4e78-ab03-420bedd9902d req-3f441c0a-4646-4b2d-9d22-d3b88ae38004 service nova] Creating event network-vif-plugged:41322bc8-3eed-473b-9211-8d5e941690f8 for instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f on hv-cinder-84932 Jul 12 17:43:16.965629 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-1c8ce07a-b322-4e78-ab03-420bedd9902d req-3f441c0a-4646-4b2d-9d22-d3b88ae38004 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085111 Jul 12 17:43:16.966219 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 668/1300] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:43:17.866763 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-850f0b42-5282-4897-a4f8-311afb094b1d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:17.867378 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-850f0b42-5282-4897-a4f8-311afb094b1d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:17.869284 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:43:17.869986 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell0:SELECT=6 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:43:17.876430 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-850f0b42-5282-4897-a4f8-311afb094b1d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:17.876878 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-850f0b42-5282-4897-a4f8-311afb094b1d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:17.877642 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-850f0b42-5282-4897-a4f8-311afb094b1d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:17.878104 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-850f0b42-5282-4897-a4f8-311afb094b1d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:18.004046 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-850f0b42-5282-4897-a4f8-311afb094b1d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:18.011295 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-850f0b42-5282-4897-a4f8-311afb094b1d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f" status: 200 len: 1362 microversion: 2.1 time: 0.148410 Jul 12 17:43:18.011850 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 633/1301] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:17 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:19.024483 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell0:SELECT=6 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:43:19.029411 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2d2d0a5f-d4eb-4793-a259-ef807b73f462 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:19.030177 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2d2d0a5f-d4eb-4793-a259-ef807b73f462 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:19.036612 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d2d0a5f-d4eb-4793-a259-ef807b73f462 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:19.037066 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d2d0a5f-d4eb-4793-a259-ef807b73f462 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:19.038390 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d2d0a5f-d4eb-4793-a259-ef807b73f462 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:19.038827 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2d2d0a5f-d4eb-4793-a259-ef807b73f462 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:19.166278 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2d2d0a5f-d4eb-4793-a259-ef807b73f462 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:43:19.173595 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2d2d0a5f-d4eb-4793-a259-ef807b73f462 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f" status: 200 len: 1548 microversion: 2.1 time: 0.150061 Jul 12 17:43:19.174187 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 669/1302] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:43:19 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:43:19.190102 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6a1a2433-d356-48dd-abca-58607444b64d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:43:19.190606 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6a1a2433-d356-48dd-abca-58607444b64d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:43:19.197523 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6a1a2433-d356-48dd-abca-58607444b64d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:19.198004 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6a1a2433-d356-48dd-abca-58607444b64d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:19.198770 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6a1a2433-d356-48dd-abca-58607444b64d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:19.199206 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6a1a2433-d356-48dd-abca-58607444b64d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:19.277574 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6a1a2433-d356-48dd-abca-58607444b64d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091389 Jul 12 17:43:19.278198 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 634/1303] 10.222.0.62 () {58 vars in 1274 bytes} [Tue Jul 12 17:43:19 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:43:20.177796 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [req-30784b51-5406-4910-8a27-8ef3c38f8578 req-d609e791-1d3e-4015-8678-56aeb3442cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eafefc35-452e-4b7a-a39d-bea2bfd33a1f", "tag": "41322bc8-3eed-473b-9211-8d5e941690f8"}]} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:43:20.186860 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-30784b51-5406-4910-8a27-8ef3c38f8578 req-d609e791-1d3e-4015-8678-56aeb3442cfc service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:43:20.187302 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [req-30784b51-5406-4910-8a27-8ef3c38f8578 req-d609e791-1d3e-4015-8678-56aeb3442cfc service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:43:20.198063 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.compute.server_external_events [req-30784b51-5406-4910-8a27-8ef3c38f8578 req-d609e791-1d3e-4015-8678-56aeb3442cfc service nova] Creating event network-changed:41322bc8-3eed-473b-9211-8d5e941690f8 for instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f on hv-cinder-84932 Jul 12 17:43:20.202947 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [req-30784b51-5406-4910-8a27-8ef3c38f8578 req-d609e791-1d3e-4015-8678-56aeb3442cfc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028822 Jul 12 17:43:20.203524 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 670/1304] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 17:44:25.663316 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:44:25.663999 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Tue Jul 12 17:44:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:44:35.332533 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:44:35.333291 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=64 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:44:35.439415 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-7f3c5333-38ca-4e88-b032-0826a17d0787 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:35.439940 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-7f3c5333-38ca-4e88-b032-0826a17d0787 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:35.445826 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f3c5333-38ca-4e88-b032-0826a17d0787 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:35.446276 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f3c5333-38ca-4e88-b032-0826a17d0787 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:35.447037 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f3c5333-38ca-4e88-b032-0826a17d0787 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:35.447476 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-7f3c5333-38ca-4e88-b032-0826a17d0787 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:35.471793 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-7f3c5333-38ca-4e88-b032-0826a17d0787 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/ips" status: 200 len: 145 microversion: 2.1 time: 0.141152 Jul 12 17:44:35.472334 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 635/1305] 10.222.0.62 () {58 vars in 1247 bytes} [Tue Jul 12 17:44:35 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/ips => generated 145 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:36.775591 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:44:36.776336 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG dbcounter [-] [117938] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:44:36.782172 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-4bd09235-055d-4b6b-ab1b-8ef85b01e31d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b8c65a9-683a-4300-b244-deb02081d991"}} {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:44:36.783303 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-4bd09235-055d-4b6b-ab1b-8ef85b01e31d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:36.791515 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4bd09235-055d-4b6b-ab1b-8ef85b01e31d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:36.792090 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4bd09235-055d-4b6b-ab1b-8ef85b01e31d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:36.792848 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4bd09235-055d-4b6b-ab1b-8ef85b01e31d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:36.793284 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-4bd09235-055d-4b6b-ab1b-8ef85b01e31d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:37.048858 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-4bd09235-055d-4b6b-ab1b-8ef85b01e31d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "POST /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275170 Jul 12 17:44:37.049466 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 671/1306] 10.222.0.62 () {60 vars in 1322 bytes} [Tue Jul 12 17:44:36 2022] POST /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:44.527135 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-eab182ca-0a7d-4a96-a49e-6b58f368b20b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:44.528709 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-eab182ca-0a7d-4a96-a49e-6b58f368b20b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:44.535140 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eab182ca-0a7d-4a96-a49e-6b58f368b20b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:44.535590 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eab182ca-0a7d-4a96-a49e-6b58f368b20b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:44.536355 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eab182ca-0a7d-4a96-a49e-6b58f368b20b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:44.536791 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-eab182ca-0a7d-4a96-a49e-6b58f368b20b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:44.566894 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-eab182ca-0a7d-4a96-a49e-6b58f368b20b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043729 Jul 12 17:44:44.567434 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 636/1307] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:44:44 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:44.578676 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-decee7e7-81ec-4e1c-97d6-42ea988389cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:44.579260 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-decee7e7-81ec-4e1c-97d6-42ea988389cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:44.585486 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-decee7e7-81ec-4e1c-97d6-42ea988389cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:44.585971 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-decee7e7-81ec-4e1c-97d6-42ea988389cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:44.586736 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-decee7e7-81ec-4e1c-97d6-42ea988389cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:44.587176 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-decee7e7-81ec-4e1c-97d6-42ea988389cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:44.614964 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-decee7e7-81ec-4e1c-97d6-42ea988389cb tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments/9b8c65a9-683a-4300-b244-deb02081d991" status: 200 len: 194 microversion: 2.1 time: 0.041608 Jul 12 17:44:44.615525 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 672/1308] 10.222.0.62 () {58 vars in 1412 bytes} [Tue Jul 12 17:44:44 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments/9b8c65a9-683a-4300-b244-deb02081d991 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:45.923877 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-120e98aa-e44c-4fb2-887f-39eda1a89356 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14283f94-ffb2-4df3-82e2-8a7b346b9ed7"}} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:44:45.924937 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-120e98aa-e44c-4fb2-887f-39eda1a89356 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:45.931707 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-120e98aa-e44c-4fb2-887f-39eda1a89356 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:45.932161 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-120e98aa-e44c-4fb2-887f-39eda1a89356 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:45.932933 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-120e98aa-e44c-4fb2-887f-39eda1a89356 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:45.933371 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-120e98aa-e44c-4fb2-887f-39eda1a89356 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:46.182032 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-120e98aa-e44c-4fb2-887f-39eda1a89356 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "POST /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261652 Jul 12 17:44:46.187646 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 637/1309] 10.222.0.62 () {60 vars in 1322 bytes} [Tue Jul 12 17:44:45 2022] POST /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:53.657633 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-6c3e9cbc-7849-49a8-8b18-4fd6f14a0070 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:53.658636 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-6c3e9cbc-7849-49a8-8b18-4fd6f14a0070 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:53.665068 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6c3e9cbc-7849-49a8-8b18-4fd6f14a0070 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:53.665711 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6c3e9cbc-7849-49a8-8b18-4fd6f14a0070 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:53.666477 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6c3e9cbc-7849-49a8-8b18-4fd6f14a0070 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:53.666906 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-6c3e9cbc-7849-49a8-8b18-4fd6f14a0070 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:53.695716 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-6c3e9cbc-7849-49a8-8b18-4fd6f14a0070 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042094 Jul 12 17:44:53.696254 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 673/1310] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:44:53 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:53.839352 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ae5a3dfa-cc20-482a-993d-e0483750a12d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:53.839904 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ae5a3dfa-cc20-482a-993d-e0483750a12d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:53.846620 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ae5a3dfa-cc20-482a-993d-e0483750a12d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:53.847085 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ae5a3dfa-cc20-482a-993d-e0483750a12d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:53.847829 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ae5a3dfa-cc20-482a-993d-e0483750a12d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:53.848268 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ae5a3dfa-cc20-482a-993d-e0483750a12d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:53.876130 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ae5a3dfa-cc20-482a-993d-e0483750a12d tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments/9b8c65a9-683a-4300-b244-deb02081d991" status: 200 len: 194 microversion: 2.1 time: 0.041234 Jul 12 17:44:53.876690 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 638/1311] 10.222.0.62 () {58 vars in 1412 bytes} [Tue Jul 12 17:44:53 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments/9b8c65a9-683a-4300-b244-deb02081d991 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:53.886040 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-d45fc43a-a62d-462a-b741-5a3cea810800 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:53.887183 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-d45fc43a-a62d-462a-b741-5a3cea810800 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:53.893008 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d45fc43a-a62d-462a-b741-5a3cea810800 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:53.893456 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d45fc43a-a62d-462a-b741-5a3cea810800 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:53.894237 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d45fc43a-a62d-462a-b741-5a3cea810800 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:53.894666 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-d45fc43a-a62d-462a-b741-5a3cea810800 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:53.975357 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-d45fc43a-a62d-462a-b741-5a3cea810800 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lazy-loading 'services' on Instance uuid eafefc35-452e-4b7a-a39d-bea2bfd33a1f {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:44:54.045141 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-d45fc43a-a62d-462a-b741-5a3cea810800 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "DELETE /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments/9b8c65a9-683a-4300-b244-deb02081d991" status: 202 len: 0 microversion: 2.1 time: 0.162856 Jul 12 17:44:54.045750 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 674/1312] 10.222.0.62 () {58 vars in 1415 bytes} [Tue Jul 12 17:44:53 2022] DELETE /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments/9b8c65a9-683a-4300-b244-deb02081d991 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:44:55.156746 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-73797c44-d405-4e0b-8e38-31e23ba2bc99 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:55.157274 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-73797c44-d405-4e0b-8e38-31e23ba2bc99 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:55.163774 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-73797c44-d405-4e0b-8e38-31e23ba2bc99 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:55.164223 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-73797c44-d405-4e0b-8e38-31e23ba2bc99 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:55.165043 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-73797c44-d405-4e0b-8e38-31e23ba2bc99 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:55.165462 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-73797c44-d405-4e0b-8e38-31e23ba2bc99 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:55.194417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-73797c44-d405-4e0b-8e38-31e23ba2bc99 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments/14283f94-ffb2-4df3-82e2-8a7b346b9ed7" status: 200 len: 194 microversion: 2.1 time: 0.041685 Jul 12 17:44:55.195017 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 639/1313] 10.222.0.62 () {58 vars in 1412 bytes} [Tue Jul 12 17:44:55 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments/14283f94-ffb2-4df3-82e2-8a7b346b9ed7 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:44:55.206421 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-db32ef13-aa46-4fca-bbb4-f72e607dc678 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:55.206997 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-db32ef13-aa46-4fca-bbb4-f72e607dc678 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:55.213023 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db32ef13-aa46-4fca-bbb4-f72e607dc678 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:55.213445 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db32ef13-aa46-4fca-bbb4-f72e607dc678 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:55.214230 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db32ef13-aa46-4fca-bbb4-f72e607dc678 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:55.214662 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-db32ef13-aa46-4fca-bbb4-f72e607dc678 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:55.291533 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-db32ef13-aa46-4fca-bbb4-f72e607dc678 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lazy-loading 'services' on Instance uuid eafefc35-452e-4b7a-a39d-bea2bfd33a1f {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:44:55.359700 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-db32ef13-aa46-4fca-bbb4-f72e607dc678 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "DELETE /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments/14283f94-ffb2-4df3-82e2-8a7b346b9ed7" status: 202 len: 0 microversion: 2.1 time: 0.157902 Jul 12 17:44:55.360270 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 675/1314] 10.222.0.62 () {58 vars in 1415 bytes} [Tue Jul 12 17:44:55 2022] DELETE /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments/14283f94-ffb2-4df3-82e2-8a7b346b9ed7 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 17:44:56.518432 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-b5d63c0c-8a89-435f-8d53-91acf38e21c6 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:56.519417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-b5d63c0c-8a89-435f-8d53-91acf38e21c6 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:56.525932 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b5d63c0c-8a89-435f-8d53-91acf38e21c6 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:56.526391 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b5d63c0c-8a89-435f-8d53-91acf38e21c6 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:56.527162 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b5d63c0c-8a89-435f-8d53-91acf38e21c6 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:56.527600 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-b5d63c0c-8a89-435f-8d53-91acf38e21c6 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:56.556864 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-b5d63c0c-8a89-435f-8d53-91acf38e21c6 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042363 Jul 12 17:44:56.557419 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 640/1315] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:44:56 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 17:44:56.662364 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-e092b491-85d1-42be-9da4-56fd6e1b4ef7 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:56.663392 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-e092b491-85d1-42be-9da4-56fd6e1b4ef7 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:56.670156 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e092b491-85d1-42be-9da4-56fd6e1b4ef7 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:56.670628 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e092b491-85d1-42be-9da4-56fd6e1b4ef7 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:56.671425 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e092b491-85d1-42be-9da4-56fd6e1b4ef7 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:56.671807 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-e092b491-85d1-42be-9da4-56fd6e1b4ef7 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:56.699679 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-e092b491-85d1-42be-9da4-56fd6e1b4ef7 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042114 Jul 12 17:44:56.700222 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 676/1316] 10.222.0.62 () {58 vars in 1301 bytes} [Tue Jul 12 17:44:56 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 17:44:56.756624 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-ffea4429-ce22-45a8-99b4-fae192f9568b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:56.757120 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ffea4429-ce22-45a8-99b4-fae192f9568b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:56.763191 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ffea4429-ce22-45a8-99b4-fae192f9568b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:56.763646 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ffea4429-ce22-45a8-99b4-fae192f9568b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:56.764408 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ffea4429-ce22-45a8-99b4-fae192f9568b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:56.764891 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-ffea4429-ce22-45a8-99b4-fae192f9568b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:56.790049 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-ffea4429-ce22-45a8-99b4-fae192f9568b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Going to try to terminate instance {{(pid=117939) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 17:44:56.864322 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-ffea4429-ce22-45a8-99b4-fae192f9568b tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "DELETE /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f" status: 204 len: 0 microversion: 2.1 time: 0.111237 Jul 12 17:44:56.864898 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 641/1317] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:44:56 2022] DELETE /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 17:44:56.876061 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-c31ab265-cc37-49ac-b32b-b83951a69d44 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:56.876668 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-c31ab265-cc37-49ac-b32b-b83951a69d44 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:56.882734 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c31ab265-cc37-49ac-b32b-b83951a69d44 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:56.883186 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c31ab265-cc37-49ac-b32b-b83951a69d44 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:56.883936 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c31ab265-cc37-49ac-b32b-b83951a69d44 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:56.884368 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-c31ab265-cc37-49ac-b32b-b83951a69d44 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:57.018802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-c31ab265-cc37-49ac-b32b-b83951a69d44 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:57.026296 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-c31ab265-cc37-49ac-b32b-b83951a69d44 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f" status: 200 len: 1672 microversion: 2.1 time: 0.156968 Jul 12 17:44:57.026860 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 677/1318] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:56 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:58.044944 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-bb452398-ad87-4aa5-9cf7-237f48734a46 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:58.045645 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-bb452398-ad87-4aa5-9cf7-237f48734a46 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:58.052052 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bb452398-ad87-4aa5-9cf7-237f48734a46 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:58.052504 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bb452398-ad87-4aa5-9cf7-237f48734a46 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:58.053521 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bb452398-ad87-4aa5-9cf7-237f48734a46 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:58.053989 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-bb452398-ad87-4aa5-9cf7-237f48734a46 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:58.182017 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.policy [None req-bb452398-ad87-4aa5-9cf7-237f48734a46 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117939) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:58.189501 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-bb452398-ad87-4aa5-9cf7-237f48734a46 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f" status: 200 len: 1672 microversion: 2.1 time: 0.149262 Jul 12 17:44:58.190092 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 642/1319] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:58 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:44:59.206605 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-2c1d6ac1-4c15-43e5-bff4-8eb5f6dca757 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:44:59.207218 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-2c1d6ac1-4c15-43e5-bff4-8eb5f6dca757 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:44:59.213547 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c1d6ac1-4c15-43e5-bff4-8eb5f6dca757 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:59.214029 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c1d6ac1-4c15-43e5-bff4-8eb5f6dca757 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:59.214863 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c1d6ac1-4c15-43e5-bff4-8eb5f6dca757 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:44:59.215306 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-2c1d6ac1-4c15-43e5-bff4-8eb5f6dca757 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:44:59.444968 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-2c1d6ac1-4c15-43e5-bff4-8eb5f6dca757 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:44:59.452377 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-2c1d6ac1-4c15-43e5-bff4-8eb5f6dca757 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f" status: 200 len: 1672 microversion: 2.1 time: 0.249592 Jul 12 17:44:59.452948 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 678/1320] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:44:59 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f => generated 1672 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:00.201910 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [req-f6f351b5-c5ec-4a93-b869-eb406a3880f8 req-baca387a-c93f-4428-ba63-d82ab91c7fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eafefc35-452e-4b7a-a39d-bea2bfd33a1f", "name": "network-vif-deleted", "tag": "41322bc8-3eed-473b-9211-8d5e941690f8"}]} {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 17:45:00.211181 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-f6f351b5-c5ec-4a93-b869-eb406a3880f8 req-baca387a-c93f-4428-ba63-d82ab91c7fd9 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:00.211632 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [req-f6f351b5-c5ec-4a93-b869-eb406a3880f8 req-baca387a-c93f-4428-ba63-d82ab91c7fd9 service nova] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:00.224266 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.compute.server_external_events [req-f6f351b5-c5ec-4a93-b869-eb406a3880f8 req-baca387a-c93f-4428-ba63-d82ab91c7fd9 service nova] Creating event network-vif-deleted:41322bc8-3eed-473b-9211-8d5e941690f8 for instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f on hv-cinder-84932 Jul 12 17:45:00.229444 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [req-f6f351b5-c5ec-4a93-b869-eb406a3880f8 req-baca387a-c93f-4428-ba63-d82ab91c7fd9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032291 Jul 12 17:45:00.230213 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 643/1321] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Jul 12 17:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 17:45:00.469488 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-46c6c0dd-bb96-4d26-a3ce-acae7a46be29 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:00.470127 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-46c6c0dd-bb96-4d26-a3ce-acae7a46be29 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:00.476661 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-46c6c0dd-bb96-4d26-a3ce-acae7a46be29 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:00.477121 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-46c6c0dd-bb96-4d26-a3ce-acae7a46be29 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:00.477916 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-46c6c0dd-bb96-4d26-a3ce-acae7a46be29 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:00.478358 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-46c6c0dd-bb96-4d26-a3ce-acae7a46be29 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:00.509196 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-46c6c0dd-bb96-4d26-a3ce-acae7a46be29 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:00.509650 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-46c6c0dd-bb96-4d26-a3ce-acae7a46be29 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:00.510138 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.objects.instance [None req-46c6c0dd-bb96-4d26-a3ce-acae7a46be29 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lazy-loading 'fault' on Instance uuid eafefc35-452e-4b7a-a39d-bea2bfd33a1f {{(pid=117938) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 17:45:00.550011 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.policy [None req-46c6c0dd-bb96-4d26-a3ce-acae7a46be29 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1d5c8b5b8a43799e4b191b9b10db48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c087dddd214fb881ff86e6ece45195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117938) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 17:45:00.557723 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-46c6c0dd-bb96-4d26-a3ce-acae7a46be29 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f" status: 200 len: 1327 microversion: 2.1 time: 0.092122 Jul 12 17:45:00.558295 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 679/1322] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:00 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f => generated 1327 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 17:45:01.576722 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6ffc5210-2342-42d1-b057-045e59f083bf tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:01.577424 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-6ffc5210-2342-42d1-b057-045e59f083bf tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:01.583659 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6ffc5210-2342-42d1-b057-045e59f083bf tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:01.584110 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6ffc5210-2342-42d1-b057-045e59f083bf tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:01.584877 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6ffc5210-2342-42d1-b057-045e59f083bf tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:01.585316 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-6ffc5210-2342-42d1-b057-045e59f083bf tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:01.600265 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-6ffc5210-2342-42d1-b057-045e59f083bf tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] HTTP exception thrown: Instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f could not be found. Jul 12 17:45:01.601889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6ffc5210-2342-42d1-b057-045e59f083bf tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Request method failure captured: Jul 12 17:45:01.601889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f HTTP/1.1 Jul 12 17:45:01.601889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:45:01.601889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:45:01.601889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:45:01.601889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:45:01.601889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:45:01.601889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:45:01.601889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:45:01.601889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:45:01.601889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABizbGcjes0vjnKLvtCxFsA7akr1C7xAVYtQHCnKKdzO8EQ0NVqs01tNxiQ6i1TxWkYrutj6zTLJjlrjp6z__h_uU-I_QWYyODeeSGdIHRhi62qo94Kz64h_fsnMSpAwyidUGEfOv01TlMncM2loI8xxw0zwnwLGnIFv6_XOldHMoqsFVA Jul 12 17:45:01.601889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:45:01.601889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:45:01.601889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:45:01.601889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:45:01.601889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:45:01.601889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:45:01.601889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: f5c087dddd214fb881ff86e6ece45195 Jul 12 17:45:01.601889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeTestJSON-832840350 Jul 12 17:45:01.601889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:45:01.601889 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:45:01.603648 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f5c087dddd214fb881ff86e6ece45195"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f5c087dddd214fb881ff86e6ece45195"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f5c087dddd214fb881ff86e6ece45195"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f5c087dddd214fb881ff86e6ece45195", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:45:01.603648 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeTestJSON-832840350 Jul 12 17:45:01.603648 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: f5c087dddd214fb881ff86e6ece45195 Jul 12 17:45:01.603648 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeTestJSON-832840350 Jul 12 17:45:01.603648 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeTestJSON-832840350-project Jul 12 17:45:01.603648 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:45:01.603648 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:45:01.603648 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: fc1d5c8b5b8a43799e4b191b9b10db48 Jul 12 17:45:01.603648 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeTestJSON-832840350-project Jul 12 17:45:01.603648 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:45:01.603648 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f could not be found. Jul 12 17:45:01.603648 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': 'eafefc35-452e-4b7a-a39d-bea2bfd33a1f'} Jul 12 17:45:01.604666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:45:01.604666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:01.604666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:45:01.604666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:45:01.604666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:45:01.604666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:45:01.604666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:45:01.604666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:45:01.604666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:45:01.604666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:45:01.604666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f could not be found. Jul 12 17:45:01.604666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:45:01.604666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:45:01.604666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:45:01.604666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:01.604666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:45:01.604666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:45:01.604666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:45:01.604666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:45:01.604666 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:45:01.606417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:45:01.606417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:45:01.606417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:45:01.606417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:45:01.606417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:45:01.606417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:45:01.606417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:45:01.606417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f could not be found. Jul 12 17:45:01.606417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:45:01.606417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:45:01.606417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:45:01.606417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:01.606417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:45:01.606417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:45:01.606417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:45:01.606417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:45:01.606417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f could not be found. Jul 12 17:45:01.606417 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:45:01.608002 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-6ffc5210-2342-42d1-b057-045e59f083bf tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Returning 404 to user: Instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:45:01.608002 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-6ffc5210-2342-42d1-b057-045e59f083bf tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f" status: 404 len: 111 microversion: 2.1 time: 0.031803 Jul 12 17:45:01.608002 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 644/1323] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:01 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:45:01.612222 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-1f67648c-b541-414d-b2d7-cd7c48953827 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '.version_select at 0x7f872e124b80>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:01.629065 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-1f67648c-b541-414d-b2d7-cd7c48953827 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1840721702" status: 202 len: 0 microversion: 2.1 time: 0.020666 Jul 12 17:45:01.629700 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 680/1324] 10.222.0.62 () {58 vars in 1220 bytes} [Tue Jul 12 17:45:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1840721702 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 17:45:04.476341 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d1eeec86-55af-455d-bc26-5280bd09a87e tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:04.476832 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-d1eeec86-55af-455d-bc26-5280bd09a87e tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:04.483837 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1eeec86-55af-455d-bc26-5280bd09a87e tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:04.484282 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1eeec86-55af-455d-bc26-5280bd09a87e tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:04.485041 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1eeec86-55af-455d-bc26-5280bd09a87e tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:04.485475 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-d1eeec86-55af-455d-bc26-5280bd09a87e tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:04.499056 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-d1eeec86-55af-455d-bc26-5280bd09a87e tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] HTTP exception thrown: Instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f could not be found. Jul 12 17:45:04.500593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d1eeec86-55af-455d-bc26-5280bd09a87e tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Request method failure captured: Jul 12 17:45:04.500593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: DELETE /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f HTTP/1.1 Jul 12 17:45:04.500593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:45:04.500593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:45:04.500593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:45:04.500593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:45:04.500593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:45:04.500593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:45:04.500593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:45:04.500593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:45:04.500593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABizbGcjes0vjnKLvtCxFsA7akr1C7xAVYtQHCnKKdzO8EQ0NVqs01tNxiQ6i1TxWkYrutj6zTLJjlrjp6z__h_uU-I_QWYyODeeSGdIHRhi62qo94Kz64h_fsnMSpAwyidUGEfOv01TlMncM2loI8xxw0zwnwLGnIFv6_XOldHMoqsFVA Jul 12 17:45:04.500593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:45:04.500593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:45:04.500593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:45:04.500593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:45:04.500593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:45:04.500593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:45:04.500593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: f5c087dddd214fb881ff86e6ece45195 Jul 12 17:45:04.500593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeTestJSON-832840350 Jul 12 17:45:04.500593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:45:04.500593 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:45:04.502422 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f5c087dddd214fb881ff86e6ece45195"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f5c087dddd214fb881ff86e6ece45195"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f5c087dddd214fb881ff86e6ece45195"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f5c087dddd214fb881ff86e6ece45195", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:45:04.502422 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeTestJSON-832840350 Jul 12 17:45:04.502422 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: f5c087dddd214fb881ff86e6ece45195 Jul 12 17:45:04.502422 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeTestJSON-832840350 Jul 12 17:45:04.502422 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeTestJSON-832840350-project Jul 12 17:45:04.502422 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:45:04.502422 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:45:04.502422 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: fc1d5c8b5b8a43799e4b191b9b10db48 Jul 12 17:45:04.502422 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeTestJSON-832840350-project Jul 12 17:45:04.502422 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:45:04.502422 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f could not be found. Jul 12 17:45:04.502422 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': 'eafefc35-452e-4b7a-a39d-bea2bfd33a1f'} Jul 12 17:45:04.506112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:45:04.506112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:04.506112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:45:04.506112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:45:04.506112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:45:04.506112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:45:04.506112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:45:04.506112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:45:04.506112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:45:04.506112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:45:04.506112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f could not be found. Jul 12 17:45:04.506112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:45:04.506112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:45:04.506112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:45:04.506112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:04.506112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:45:04.506112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:45:04.506112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:45:04.506112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:45:04.506112 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:45:04.507760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:45:04.507760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 17:45:04.507760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 17:45:04.507760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 17:45:04.507760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 17:45:04.507760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:45:04.507760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:45:04.507760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:45:04.507760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:45:04.507760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f could not be found. Jul 12 17:45:04.507760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:45:04.507760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:45:04.507760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:45:04.507760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:04.507760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:45:04.507760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:45:04.507760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:45:04.507760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:45:04.507760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f could not be found. Jul 12 17:45:04.507760 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:45:04.509383 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-d1eeec86-55af-455d-bc26-5280bd09a87e tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Returning 404 to user: Instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:45:04.509383 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-d1eeec86-55af-455d-bc26-5280bd09a87e tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "DELETE /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f" status: 404 len: 111 microversion: 2.1 time: 0.029380 Jul 12 17:45:04.509383 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 645/1325] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:45:04 2022] DELETE /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:45:04.510902 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bf7dcffc-e67f-4de6-b102-38c1ca27a538 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:04.511583 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-bf7dcffc-e67f-4de6-b102-38c1ca27a538 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: eafefc35-452e-4b7a-a39d-bea2bfd33a1f] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:04.518290 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bf7dcffc-e67f-4de6-b102-38c1ca27a538 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:04.518743 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bf7dcffc-e67f-4de6-b102-38c1ca27a538 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:04.519509 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bf7dcffc-e67f-4de6-b102-38c1ca27a538 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:04.519949 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-bf7dcffc-e67f-4de6-b102-38c1ca27a538 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:04.534384 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-bf7dcffc-e67f-4de6-b102-38c1ca27a538 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] HTTP exception thrown: Instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f could not be found. Jul 12 17:45:04.536005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bf7dcffc-e67f-4de6-b102-38c1ca27a538 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Request method failure captured: Jul 12 17:45:04.536005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f HTTP/1.1 Jul 12 17:45:04.536005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:45:04.536005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:45:04.536005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:45:04.536005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:45:04.536005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:45:04.536005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:45:04.536005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:45:04.536005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:45:04.536005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizbGcjes0vjnKLvtCxFsA7akr1C7xAVYtQHCnKKdzO8EQ0NVqs01tNxiQ6i1TxWkYrutj6zTLJjlrjp6z__h_uU-I_QWYyODeeSGdIHRhi62qo94Kz64h_fsnMSpAwyidUGEfOv01TlMncM2loI8xxw0zwnwLGnIFv6_XOldHMoqsFVA Jul 12 17:45:04.536005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:45:04.536005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:45:04.536005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:45:04.536005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:45:04.536005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:45:04.536005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:45:04.536005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: f5c087dddd214fb881ff86e6ece45195 Jul 12 17:45:04.536005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeTestJSON-832840350 Jul 12 17:45:04.536005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:45:04.536005 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:45:04.537680 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f5c087dddd214fb881ff86e6ece45195"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f5c087dddd214fb881ff86e6ece45195"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f5c087dddd214fb881ff86e6ece45195"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f5c087dddd214fb881ff86e6ece45195", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:45:04.537680 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeTestJSON-832840350 Jul 12 17:45:04.537680 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: f5c087dddd214fb881ff86e6ece45195 Jul 12 17:45:04.537680 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeTestJSON-832840350 Jul 12 17:45:04.537680 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeTestJSON-832840350-project Jul 12 17:45:04.537680 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:45:04.537680 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:45:04.537680 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: fc1d5c8b5b8a43799e4b191b9b10db48 Jul 12 17:45:04.537680 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeTestJSON-832840350-project Jul 12 17:45:04.537680 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:45:04.537680 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f could not be found. Jul 12 17:45:04.537680 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': 'eafefc35-452e-4b7a-a39d-bea2bfd33a1f'} Jul 12 17:45:04.538886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:45:04.538886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:04.538886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:45:04.538886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:45:04.538886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:45:04.538886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:45:04.538886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:45:04.538886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:45:04.538886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:45:04.538886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:45:04.538886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f could not be found. Jul 12 17:45:04.538886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:45:04.538886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:45:04.538886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:45:04.538886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:04.538886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:45:04.538886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:45:04.538886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:45:04.538886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:45:04.538886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:45:04.540802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:45:04.540802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:45:04.540802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:45:04.540802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:45:04.540802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:45:04.540802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:45:04.540802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:45:04.540802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f could not be found. Jul 12 17:45:04.540802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:45:04.540802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:45:04.540802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:45:04.540802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:04.540802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:45:04.540802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:45:04.540802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:45:04.540802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:45:04.540802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f could not be found. Jul 12 17:45:04.540802 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:45:04.542303 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-bf7dcffc-e67f-4de6-b102-38c1ca27a538 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Returning 404 to user: Instance eafefc35-452e-4b7a-a39d-bea2bfd33a1f could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:45:04.542303 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-bf7dcffc-e67f-4de6-b102-38c1ca27a538 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f" status: 404 len: 111 microversion: 2.1 time: 0.030969 Jul 12 17:45:04.542303 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 681/1326] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:04 2022] GET /compute/v2.1/servers/eafefc35-452e-4b7a-a39d-bea2bfd33a1f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:45:05.667458 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-399dfbe5-c877-4843-9236-ddabfcf8f624 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:05.668028 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.compute.api [None req-399dfbe5-c877-4843-9236-ddabfcf8f624 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117939) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:05.670472 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:45:05.675612 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-399dfbe5-c877-4843-9236-ddabfcf8f624 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:05.676053 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-399dfbe5-c877-4843-9236-ddabfcf8f624 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:05.676810 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-399dfbe5-c877-4843-9236-ddabfcf8f624 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:05.677239 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG oslo_concurrency.lockutils [None req-399dfbe5-c877-4843-9236-ddabfcf8f624 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:05.682014 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG dbcounter [-] [117939] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:45:05.692479 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.wsgi [None req-399dfbe5-c877-4843-9236-ddabfcf8f624 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] HTTP exception thrown: Instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 could not be found. Jul 12 17:45:05.694024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-399dfbe5-c877-4843-9236-ddabfcf8f624 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Request method failure captured: Jul 12 17:45:05.694024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: request: DELETE /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 HTTP/1.1 Jul 12 17:45:05.694024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept: application/json Jul 12 17:45:05.694024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Accept-Encoding: identity Jul 12 17:45:05.694024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Connection: close Jul 12 17:45:05.694024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Length: 0 Jul 12 17:45:05.694024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Content-Type: application/json Jul 12 17:45:05.694024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Host: 10.222.0.62 Jul 12 17:45:05.694024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Openstack-System-Scope: None Jul 12 17:45:05.694024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: User-Agent: python-urllib3/1.26.9 Jul 12 17:45:05.694024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Auth-Token: gAAAAABizbGcjes0vjnKLvtCxFsA7akr1C7xAVYtQHCnKKdzO8EQ0NVqs01tNxiQ6i1TxWkYrutj6zTLJjlrjp6z__h_uU-I_QWYyODeeSGdIHRhi62qo94Kz64h_fsnMSpAwyidUGEfOv01TlMncM2loI8xxw0zwnwLGnIFv6_XOldHMoqsFVA Jul 12 17:45:05.694024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Id: None Jul 12 17:45:05.694024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Domain-Name: None Jul 12 17:45:05.694024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Identity-Status: Confirmed Jul 12 17:45:05.694024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Is-Admin-Project: True Jul 12 17:45:05.694024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Id: default Jul 12 17:45:05.694024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Domain-Name: Default Jul 12 17:45:05.694024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Id: f5c087dddd214fb881ff86e6ece45195 Jul 12 17:45:05.694024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Project-Name: tempest-AttachVolumeTestJSON-832840350 Jul 12 17:45:05.694024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Role: reader,member Jul 12 17:45:05.694024 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Roles: reader,member Jul 12 17:45:05.695884 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f5c087dddd214fb881ff86e6ece45195"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f5c087dddd214fb881ff86e6ece45195"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f5c087dddd214fb881ff86e6ece45195"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f5c087dddd214fb881ff86e6ece45195", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:45:05.695884 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant: tempest-AttachVolumeTestJSON-832840350 Jul 12 17:45:05.695884 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Id: f5c087dddd214fb881ff86e6ece45195 Jul 12 17:45:05.695884 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-Tenant-Name: tempest-AttachVolumeTestJSON-832840350 Jul 12 17:45:05.695884 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User: tempest-AttachVolumeTestJSON-832840350-project Jul 12 17:45:05.695884 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Id: default Jul 12 17:45:05.695884 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Domain-Name: Default Jul 12 17:45:05.695884 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Id: fc1d5c8b5b8a43799e4b191b9b10db48 Jul 12 17:45:05.695884 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: X-User-Name: tempest-AttachVolumeTestJSON-832840350-project Jul 12 17:45:05.695884 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: method: > Jul 12 17:45:05.695884 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: exception: Instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 could not be found. Jul 12 17:45:05.695884 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: action_args: {'id': '0eadcdea-7baa-4f12-a2c8-7a6506824909'} Jul 12 17:45:05.696882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: {{(pid=117939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:45:05.696882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:05.696882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:45:05.696882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:45:05.696882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:45:05.696882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:45:05.696882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:45:05.696882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:45:05.696882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:45:05.696882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:45:05.696882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 could not be found. Jul 12 17:45:05.696882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:45:05.696882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:45:05.696882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:45:05.696882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:05.696882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:45:05.696882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:45:05.696882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:45:05.696882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:45:05.696882 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:45:05.698530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:45:05.698530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 17:45:05.698530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 17:45:05.698530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 17:45:05.698530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 17:45:05.698530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:45:05.698530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:45:05.698530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:45:05.698530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:45:05.698530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 could not be found. Jul 12 17:45:05.698530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:45:05.698530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:45:05.698530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:45:05.698530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:05.698530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:45:05.698530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:45:05.698530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:45:05.698530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:45:05.698530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 could not be found. Jul 12 17:45:05.698530 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: ERROR nova.api.openstack.wsgi Jul 12 17:45:05.700726 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: DEBUG nova.api.openstack.wsgi [None req-399dfbe5-c877-4843-9236-ddabfcf8f624 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Returning 404 to user: Instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 could not be found. {{(pid=117939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:45:05.700726 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO nova.api.openstack.requestlog [None req-399dfbe5-c877-4843-9236-ddabfcf8f624 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 404 len: 111 microversion: 2.1 time: 0.031785 Jul 12 17:45:05.700726 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: [pid: 117939|app: 0|req: 646/1327] 10.222.0.62 () {58 vars in 1238 bytes} [Tue Jul 12 17:45:05 2022] DELETE /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 17:45:05.704301 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-491ea2f9-3e92-4463-8826-7b903c2411b8 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Calling method '>' {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 17:45:05.704909 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.compute.api [None req-491ea2f9-3e92-4463-8826-7b903c2411b8 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] [instance: 0eadcdea-7baa-4f12-a2c8-7a6506824909] Fetching instance by UUID {{(pid=117938) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 17:45:05.711277 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-491ea2f9-3e92-4463-8826-7b903c2411b8 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:05.711722 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-491ea2f9-3e92-4463-8826-7b903c2411b8 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:05.712478 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-491ea2f9-3e92-4463-8826-7b903c2411b8 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 17:45:05.712908 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG oslo_concurrency.lockutils [None req-491ea2f9-3e92-4463-8826-7b903c2411b8 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Lock "38cb94f1-249d-4d6f-82ce-acee8cef23f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 17:45:05.725728 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.wsgi [None req-491ea2f9-3e92-4463-8826-7b903c2411b8 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] HTTP exception thrown: Instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 could not be found. Jul 12 17:45:05.727212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-491ea2f9-3e92-4463-8826-7b903c2411b8 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Request method failure captured: Jul 12 17:45:05.727212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: request: GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 HTTP/1.1 Jul 12 17:45:05.727212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept: application/json Jul 12 17:45:05.727212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Accept-Encoding: identity Jul 12 17:45:05.727212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Connection: close Jul 12 17:45:05.727212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Length: 0 Jul 12 17:45:05.727212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Content-Type: application/json Jul 12 17:45:05.727212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Host: 10.222.0.62 Jul 12 17:45:05.727212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Openstack-System-Scope: None Jul 12 17:45:05.727212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: User-Agent: python-urllib3/1.26.9 Jul 12 17:45:05.727212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Auth-Token: gAAAAABizbGcjes0vjnKLvtCxFsA7akr1C7xAVYtQHCnKKdzO8EQ0NVqs01tNxiQ6i1TxWkYrutj6zTLJjlrjp6z__h_uU-I_QWYyODeeSGdIHRhi62qo94Kz64h_fsnMSpAwyidUGEfOv01TlMncM2loI8xxw0zwnwLGnIFv6_XOldHMoqsFVA Jul 12 17:45:05.727212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Id: None Jul 12 17:45:05.727212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Domain-Name: None Jul 12 17:45:05.727212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Identity-Status: Confirmed Jul 12 17:45:05.727212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Is-Admin-Project: True Jul 12 17:45:05.727212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Id: default Jul 12 17:45:05.727212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Domain-Name: Default Jul 12 17:45:05.727212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Id: f5c087dddd214fb881ff86e6ece45195 Jul 12 17:45:05.727212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Project-Name: tempest-AttachVolumeTestJSON-832840350 Jul 12 17:45:05.727212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Role: reader,member Jul 12 17:45:05.727212 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Roles: reader,member Jul 12 17:45:05.728892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f5c087dddd214fb881ff86e6ece45195"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f5c087dddd214fb881ff86e6ece45195"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f5c087dddd214fb881ff86e6ece45195"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f5c087dddd214fb881ff86e6ece45195", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}] Jul 12 17:45:05.728892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant: tempest-AttachVolumeTestJSON-832840350 Jul 12 17:45:05.728892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Id: f5c087dddd214fb881ff86e6ece45195 Jul 12 17:45:05.728892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-Tenant-Name: tempest-AttachVolumeTestJSON-832840350 Jul 12 17:45:05.728892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User: tempest-AttachVolumeTestJSON-832840350-project Jul 12 17:45:05.728892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Id: default Jul 12 17:45:05.728892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Domain-Name: Default Jul 12 17:45:05.728892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Id: fc1d5c8b5b8a43799e4b191b9b10db48 Jul 12 17:45:05.728892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: X-User-Name: tempest-AttachVolumeTestJSON-832840350-project Jul 12 17:45:05.728892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: method: > Jul 12 17:45:05.728892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: exception: Instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 could not be found. Jul 12 17:45:05.728892 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: action_args: {'id': '0eadcdea-7baa-4f12-a2c8-7a6506824909'} Jul 12 17:45:05.729981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: {{(pid=117938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 17:45:05.729981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:05.729981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 17:45:05.729981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 17:45:05.729981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 17:45:05.729981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 17:45:05.729981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 17:45:05.729981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 17:45:05.729981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 17:45:05.729981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 17:45:05.729981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 could not be found. Jul 12 17:45:05.729981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:45:05.729981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:45:05.729981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:45:05.729981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:05.729981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:45:05.729981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:45:05.729981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 17:45:05.729981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 17:45:05.729981 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 17:45:05.731578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 17:45:05.731578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 17:45:05.731578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 17:45:05.731578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 17:45:05.731578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 17:45:05.731578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 17:45:05.731578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 17:45:05.731578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 could not be found. Jul 12 17:45:05.731578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:45:05.731578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 17:45:05.731578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:45:05.731578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 17:45:05.731578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 17:45:05.731578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 17:45:05.731578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 17:45:05.731578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 17:45:05.731578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 could not be found. Jul 12 17:45:05.731578 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: ERROR nova.api.openstack.wsgi Jul 12 17:45:05.733011 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: DEBUG nova.api.openstack.wsgi [None req-491ea2f9-3e92-4463-8826-7b903c2411b8 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] Returning 404 to user: Instance 0eadcdea-7baa-4f12-a2c8-7a6506824909 could not be found. {{(pid=117938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 17:45:05.733011 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO nova.api.openstack.requestlog [None req-491ea2f9-3e92-4463-8826-7b903c2411b8 tempest-AttachVolumeTestJSON-832840350 tempest-AttachVolumeTestJSON-832840350-project] 10.222.0.62 "GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909" status: 404 len: 111 microversion: 2.1 time: 0.028725 Jul 12 17:45:05.733011 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: [pid: 117938|app: 0|req: 682/1328] 10.222.0.62 () {58 vars in 1235 bytes} [Tue Jul 12 17:45:05 2022] GET /compute/v2.1/servers/0eadcdea-7baa-4f12-a2c8-7a6506824909 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 17:46:08.337510 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:46:08.338117 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Tue Jul 12 17:46:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:46:13.361344 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:46:13.362221 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Tue Jul 12 17:46:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:47:45.671792 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:47:45.672465 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Tue Jul 12 17:47:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:47:46.356059 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:47:46.356242 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Tue Jul 12 17:47:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:47:58.445870 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:47:58.446412 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Tue Jul 12 17:47:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:48:07.054404 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:48:07.054940 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Tue Jul 12 17:48:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:49:28.345704 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:49:28.346254 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Tue Jul 12 17:49:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:49:33.370668 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:49:33.371339 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Tue Jul 12 17:49:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:51:05.680886 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:51:05.681538 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Tue Jul 12 17:51:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:51:06.364080 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:51:06.364290 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Tue Jul 12 17:51:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:51:18.454116 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:51:18.454681 dv-cinder-849325-2-iscsi devstack@n-api.service[117939]: Tue Jul 12 17:51:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 17:51:27.063169 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 17:51:27.063731 dv-cinder-849325-2-iscsi devstack@n-api.service[117938]: Tue Jul 12 17:51:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!